-- Logs begin at Tue 2021-07-13 08:03:24 UTC, end at Tue 2021-07-13 09:24:27 UTC. -- Jul 13 08:27:46.343704 dv-cinder-800430-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 13 08:27:46.356691 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 13 08:27:46 2021] *** Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: nodename: dv-cinder-800430-2-iscsi Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: machine: x86_64 Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: clock source: unix Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: pcre jit disabled Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: detected number of CPU cores: 4 Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: current working directory: / Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: detected binary path: /usr/bin/uwsgi-core Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: your processes number limit is 47680 Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: your memory page size is 4096 bytes Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: detected max file descriptor number: 2048 Jul 13 08:27:46.358762 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: lock engine: pthread robust mutexes Jul 13 08:27:46.359546 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: thunder lock: enabled Jul 13 08:27:46.359546 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 13 08:27:46.359546 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 13 08:27:46.404374 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: Python main interpreter initialized at 0x5603030f49c0 Jul 13 08:27:46.404374 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: python threads support enabled Jul 13 08:27:46.404374 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: your server socket listen backlog is limited to 100 connections Jul 13 08:27:46.404374 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: your mercy for graceful operations on workers is 90 seconds Jul 13 08:27:46.404767 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 08:27:46.404845 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: *** Operational MODE: preforking *** Jul 13 08:27:46.405082 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: *** uWSGI is running in multiple interpreter mode *** Jul 13 08:27:46.405082 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: spawned uWSGI master process (pid: 72622) Jul 13 08:27:46.405290 dv-cinder-800430-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 13 08:27:46.407988 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: spawned uWSGI worker 1 (pid: 72636, cores: 1) Jul 13 08:27:46.407988 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: spawned uWSGI worker 2 (pid: 72637, cores: 1) Jul 13 08:27:46.407988 dv-cinder-800430-2-iscsi devstack@keystone.service[72622]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 08:27:51.563603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:27:51.563603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: from cryptography.utils import int_from_bytes Jul 13 08:27:51.564498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:27:51.564498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: from cryptography.utils import int_from_bytes Jul 13 08:27:51.565337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:27:51.565337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: from cryptography.utils import int_from_bytes Jul 13 08:27:51.565769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 08:27:51.565769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: from cryptography.utils import int_from_bytes Jul 13 08:27:51.613845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 08:27:51.614043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 08:27:51.614267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] command line args: [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 08:27:51.614479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 08:27:51.614647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ================================================================================ {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 08:27:51.615602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] admin_token = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.616160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 08:27:51.616252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] config_dir = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.616323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 08:27:51.616389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.616461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] command line args: [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 08:27:51.616527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] config_source = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.616527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] debug = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.616643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 08:27:51.616707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ================================================================================ {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 08:27:51.623438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] admin_token = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] insecure_debug = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] config_dir = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] config_source = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.623941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] debug = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_config_append = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] insecure_debug = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_dir = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_file = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_config_append = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.624969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625027 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_dir = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_file = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.625948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] notification_format = cadf {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.626886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] publish_errors = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.628235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] notification_format = cadf {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.628412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.628412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.628662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.628798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.628798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] publish_errors = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] standard_threads = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] strict_password_check = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.629932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.630187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.630187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] use_eventlog = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.631154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.631791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] use_journal = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.631936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] use_json = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] use_stderr = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] standard_threads = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] use_syslog = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] strict_password_check = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] watch_log_file = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.632876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.633012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.633149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] use_eventlog = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.633149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] use_journal = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.633399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.633533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] use_json = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.633661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.633795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] use_stderr = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.633795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] use_syslog = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.634061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.634189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] watch_log_file = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 08:27:51.634331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.634463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.634597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.634736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.634865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.635913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.636974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.637902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.638997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.639245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.639392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.639522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.639522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.639772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.639899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.640954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.641965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.642973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.643910 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.644974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.645108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.645248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.645383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.645512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.645901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.646058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.646198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.646877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.647224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.647377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.647510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.647639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.649089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.649306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.649473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.649667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.649860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.650088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.650289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.650524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.650726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.650893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.651095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.651288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.651481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.651734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.651913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.652109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.652303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.652496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.652726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.652946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.653146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.653316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.653508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.653703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.653933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.654113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.654325 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.654472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.654632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.654781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.654999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.enabled = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.655980 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656522 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.enabled = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.656940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.657991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.658975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.659112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.659242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.659371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.659585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.659813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.659953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.660793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.661187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.661330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.external = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.661461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.661591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.mapped = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.661800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.662748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.662953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.663110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.663255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.663402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.password = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.663624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.663777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] auth.token = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.663907 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] catalog.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.external = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.mapped = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.664849 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.password = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.665902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] auth.token = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] catalog.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.666829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.667958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.668928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.669875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.670961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.671976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.672985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.673872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.674652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.675897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.676954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.677086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.677217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.678002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.678635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.678796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.678950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.679896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.680972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.681912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.682839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.password = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.683949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.684920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.password = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.685745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686672 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.686803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.687915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.688928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.689954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.690854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.691921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.692168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.692306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.692306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.692575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.692705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.692834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.693023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.693023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.694312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.694445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.694445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.694690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.694829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.694829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.695315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.695451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] policy.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.695594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.695725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.695725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.695979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] receipt.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.696869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.697881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] policy.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] revoke.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.698898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] role.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] role.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] role.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] role.list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.699835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] receipt.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.700999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.701903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.702690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.703988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.704233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.704363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.704363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.704632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] revoke.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.704768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.704768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] role.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.705920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] role.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] role.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] role.list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.provider = fernet {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.706981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.707231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.707361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.707490 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.707631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.707631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.707631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.708003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.708134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.708134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] trust.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.708400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.708562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.708562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.709363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.709512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.709512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.709785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.709925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.709925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.710184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.710336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.710481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.710628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.710628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.connection = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.710889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.711858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.712877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.713391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.713528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.713528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.713786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.713923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.714975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.716133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.provider = fernet {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] trust.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.connection = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.718398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.719618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.720762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.720762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.720762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.720762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.720762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.721412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.721412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 08:27:51.721412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=72636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 08:27:51.732514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.732802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.732967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.742580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.748687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.748918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.749143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.757966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.771949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.772173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.777107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.777340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.827304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.827606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.882807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.883171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.954030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.954334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.954594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.954752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.954899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.955159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.955342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.955562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.981991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.982271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.982422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.982643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.982864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.983114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.983332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.997720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.998016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.998162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.998369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.998588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:51.998805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.013900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.014189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.014368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.014549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.014767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.015011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.015226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.027021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.040839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.041136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.041371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.041524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.041708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.041928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.042146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.060579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.060916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:27:52.061119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.061302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:27:52.061586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.061842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.062099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.062351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.073918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.074254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.074460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.074745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.079347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.082498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.082728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.082975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.083130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.083273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.083413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.084252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.084470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=72637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 08:27:52.086979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.087266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.087549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.087830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.088117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.088376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.088644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.088915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.089183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.089453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.089717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.094722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.094956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:27:52.095515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.095793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 08:27:52.095975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.096243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.096505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.096768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.108041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.108327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.108640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.108923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.116571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.117877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.118183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.118471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.121118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.121394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.121676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.121957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.122238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.122500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.122769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.123061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.123334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.123605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.123752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.123893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.124077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.124358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.132188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.132509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.136853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.137135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.137417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.137698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.137971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.138242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.138515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.138781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.151353 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.152966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.153377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.157542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.157819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.158526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.158949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.159256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.162418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.166024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.166434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.168707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.169009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.171473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.173438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.173725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.174003 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.174281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.174570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.174850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.175026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.175179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.175410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.179208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.179509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.179793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.180073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.180346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.180629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.200358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.200660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.200935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.201195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.201579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.201866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.206383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.209008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.210123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.210410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.210695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.210988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.214230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.214513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.214794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.215099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.215379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.216795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.223702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.228696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.228979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.229257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.229534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.229910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.230192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.230463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.230553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.230798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.231101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.231433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.231741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.232019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.249373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.252036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.252333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.252597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.252684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.252855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.256500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.258211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.259848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.260125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.260407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.261315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.263013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.263284 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.266406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.266692 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.266989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.267269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.267548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.267666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.269198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.272763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.273053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.274598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.274877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.281061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.281339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.281611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.281977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.282252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.282540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.282818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.283950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.284234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.284511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.292748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=72636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.293023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.293308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.293573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.293848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.294216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.294504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.294772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.295079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.295360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.295631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.295907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.296179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.296451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=72636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.300557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.304373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.307687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.309414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.311045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.311323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.311597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.319372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.320952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.325463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.325753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.326034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.326333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.335552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.335662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603030f49c0 pid: 72636 (default app) Jul 13 08:27:52.335863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.336042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.339263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa358-c194-46b1-8a1e-9ee6e19892c9 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:27:52.339559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa358-c194-46b1-8a1e-9ee6e19892c9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:27:52.339839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa358-c194-46b1-8a1e-9ee6e19892c9 None None] PATH_INFO: `/v3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:27:52.343893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=72637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 08:27:52.344172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.345550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 792 bytes} [Tue Jul 13 08:27:52 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:27:52.346173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.346461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.346735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.347185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.347479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.347745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.348019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.348301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.348561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.348818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.349087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.349375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=72637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 08:27:52.387955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603030f49c0 pid: 72637 (default app) Jul 13 08:28:00.229911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f687b-8eab-4195-9687-edbfd1757727 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:00.230516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f687b-8eab-4195-9687-edbfd1757727 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:00.230516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f687b-8eab-4195-9687-edbfd1757727 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:00.232525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:00.244140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:00.244540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:00.244702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:00.281981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG oslo_db.sqlalchemy.engines [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:28:00.486425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG passlib.handlers.bcrypt [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=72637) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 08:28:00.486761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG passlib.handlers.bcrypt [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=72637) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 08:28:00.544167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:00.545739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:00.694208 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1/3] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:00.824936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f687b-8eab-4195-9687-edbfd1757727 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:00.858851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG oslo_db.sqlalchemy.engines [None req-a38f687b-8eab-4195-9687-edbfd1757727 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 08:28:00.987697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f687b-8eab-4195-9687-edbfd1757727 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:00.991762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:00.992422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:00.992706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:00.992984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:01.000740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:01.053671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.common.rbac_enforcer.enforcer [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 08:28:01.054007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0034-2b79-4e78-889a-22b084414a47 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:01.063717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:01.069635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:01.083014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948c395-c517-478d-9ad3-4373953e2c34 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:01.087780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:01.088957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:01.089308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:01.089649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] PATH_INFO: `/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:01.091192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] RBAC: Authorizing `identity:get_project(project_id=25cc3ad984ea4044b5e9444df5ff7faf)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:01.143719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 08:28:01.144059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801e90a-3445-49fc-8c0f-8e0604519e41 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:01.149753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 2/5] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:01 2021] GET /identity/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:03.298611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0ba8-4e99-4427-a894-3a29b15bcc7d None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:03.299152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0ba8-4e99-4427-a894-3a29b15bcc7d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:03.299259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0ba8-4e99-4427-a894-3a29b15bcc7d None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:03.303836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 4/6] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:03 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:03.309540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:03.309951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:03.310106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:03.328320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:03.329810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:03.338476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:03.362160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a0ba8-4e99-4427-a894-3a29b15bcc7d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:03.373845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a0ba8-4e99-4427-a894-3a29b15bcc7d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:03.377789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265131-8429-49a9-8907-36f4cf1f5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:03.378422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265131-8429-49a9-8907-36f4cf1f5081 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:03.378704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265131-8429-49a9-8907-36f4cf1f5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:03.379012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265131-8429-49a9-8907-36f4cf1f5081 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:03.387238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265131-8429-49a9-8907-36f4cf1f5081 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:03.389011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265131-8429-49a9-8907-36f4cf1f5081 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:03.398530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:03.404328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:03.413027 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d953d-908e-4702-84ff-e19221b07d2c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:03.417323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c661c-f96a-4d66-b6a7-5a684a730889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:03.418254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c661c-f96a-4d66-b6a7-5a684a730889 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:03.418543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c661c-f96a-4d66-b6a7-5a684a730889 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:03.418814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c661c-f96a-4d66-b6a7-5a684a730889 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:03.420198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c661c-f96a-4d66-b6a7-5a684a730889 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:03.422054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c661c-f96a-4d66-b6a7-5a684a730889 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:03.423591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 4/9] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:03 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:05.645024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a10a-c1fa-41d2-ba41-76cd1e0802bf None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.646636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a10a-c1fa-41d2-ba41-76cd1e0802bf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.646636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a10a-c1fa-41d2-ba41-76cd1e0802bf None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.648286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:05.654256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b110-a39d-47d7-a408-b4f6cefd08b2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.654747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b110-a39d-47d7-a408-b4f6cefd08b2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.654897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b110-a39d-47d7-a408-b4f6cefd08b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.672380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6ae1b110-a39d-47d7-a408-b4f6cefd08b2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:05.673514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6ae1b110-a39d-47d7-a408-b4f6cefd08b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:05.680433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed1bc-fdfd-4e57-bebe-77c4b0d918eb None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.680724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed1bc-fdfd-4e57-bebe-77c4b0d918eb None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.681011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed1bc-fdfd-4e57-bebe-77c4b0d918eb None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.681198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 5/11] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:05.682712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 7/12] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:05.688223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.688512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.688791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.706321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:05.708091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:05.713265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed1bc-fdfd-4e57-bebe-77c4b0d918eb None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.719050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 6/13] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:05.725831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed1bc-fdfd-4e57-bebe-77c4b0d918eb None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.729942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.731468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.731468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.731691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.744944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.753494 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:05.755367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978b39-0a74-404c-9f08-08dfd0aec2c3 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.760389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:05.770956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.771213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 8/14] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:05.771322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.771322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.771322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.775331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.776390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:05.778773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:05.787825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f53e7-4768-43f7-84ca-92f891c6cd2a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.793712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 7/15] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:05.794132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.796013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.800462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.804673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.804981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.805813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:05.806122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:05.807936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:05.807936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:05.807936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:05.808861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:05.809918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61b22b-3d9c-457a-9bc3-716af97767fc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.814309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.815117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.815404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.815681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.816849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:05.819166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:05.820731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 8/16] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:05.823381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:05.829487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.840177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf59079-3dc7-48de-9d75-b84bdb513d95 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.844513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.845409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.845697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.845975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.847225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:05.850344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:05.852074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 9/18] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:05.857916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.868268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c273-89e5-49b3-aaf8-35db30728092 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.872805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587dd5-b5a1-4dc7-9a9b-dbbdb51ad177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.873757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587dd5-b5a1-4dc7-9a9b-dbbdb51ad177 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.874045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587dd5-b5a1-4dc7-9a9b-dbbdb51ad177 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.874322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587dd5-b5a1-4dc7-9a9b-dbbdb51ad177 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.876540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587dd5-b5a1-4dc7-9a9b-dbbdb51ad177 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:05.878761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587dd5-b5a1-4dc7-9a9b-dbbdb51ad177 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:05.880597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:05.886711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:05.896972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea52e-7521-4fd6-b0a9-c5a37e6646e7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:05.901150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:05.901824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:05.902107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:05.902381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:05.903273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.domain.id=default, user.id=fe1a2ced475c48049c83dfdc6c90aecc) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:05.903585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:05.905372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:05.905372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:05.905372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:05.906558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702feb-384d-493e-8bab-daeef8a23af6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:05.914946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 10/20] 10.222.0.66 () {56 vars in 1344 bytes} [Tue Jul 13 08:28:05 2021] GET /identity/v3/role_assignments?user.id=fe1a2ced475c48049c83dfdc6c90aecc&scope.domain.id=default&role.id=620fb448cda4468da4c7442522368bea => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:08.524448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4622-8121-4b47-b13a-97e628ed6193 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.524946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4622-8121-4b47-b13a-97e628ed6193 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.524946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4622-8121-4b47-b13a-97e628ed6193 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.526942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:08.540662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.541153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.541253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.552269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74017-7c87-4f95-a06b-7749b37f0976 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.553176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74017-7c87-4f95-a06b-7749b37f0976 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.553176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74017-7c87-4f95-a06b-7749b37f0976 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.554794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 12/22] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:08.560629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.560913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.561193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.576183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:08.577373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:08.601743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:08.625562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG passlib.handlers.bcrypt [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=72636) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 08:28:08.626101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG passlib.handlers.bcrypt [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=72636) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 08:28:08.640541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:08.657589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fea7f-e9d5-4f17-80fd-e2f3b0195927 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:08.670605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:08.671452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.671744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.672019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.688702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:08.690633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:08.702766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:08.704394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:08.723146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:08.731437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 12/24] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:08.741049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:08.764809 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:08.768040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a21159-0a4c-4efc-9146-083273641f85 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:08.800243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:08.800938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.801225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.801502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.802457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:08.802637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:08.803672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:08.803672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:08.803672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:08.804618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:08.816654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:08.830935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6177de-7369-4d7f-a5c0-fd86f16ab092 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:08.835659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:08.837387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.841860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.841860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.842237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 13/26] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:08.844655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:08.863873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09b52-f2fd-4524-978e-a4a7f6b72413 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:08.876510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:08.890949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:08.890949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.890949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.890949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.891885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:08.891885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:08.891885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:08.891885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:08.892858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a743cf-b04d-43f3-b74c-0c4705c03406 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:08.893701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:08.899823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 14/27] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:08.906711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:08.921613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019c36-1716-4c1a-a203-6786796c4a9a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:08.935633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:08.936565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.936769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.937223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.937764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:08.938151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:08.941011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:08.951524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 15/28] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:08.956968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:08.972812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043ac4-ebfe-4b79-bef5-65e9b3775c91 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:08.977487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:08.978373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:08.978659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:08.979071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:08.980602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:08.982502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:08.992540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 16/29] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:08 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:08.997916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:09.007462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ce564-65c0-4acb-880d-5e6c4a25992a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:09.019087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:09.019886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.020169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.021291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.022436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:09.024327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:09.026287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 17/30] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:09.032243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:09.041762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512278ae-691b-4a4a-9859-60d4072926c9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:09.055659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:09.056459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.056736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.057045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] PATH_INFO: `/v3/domains/default/users/fe1a2ced475c48049c83dfdc6c90aecc/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.059013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fe1a2ced475c48049c83dfdc6c90aecc, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:09.060031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:09.060031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:09.060031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:09.062009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0252e13-fef9-45f7-98f7-dfec5e7329de admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:09.190155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 14/31] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:28:08 2021] POST /identity/v3/projects => generated 301 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:09.324578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 18/32] 10.222.0.66 () {58 vars in 1383 bytes} [Tue Jul 13 08:28:09 2021] PUT /identity/v3/domains/default/users/fe1a2ced475c48049c83dfdc6c90aecc/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:28:09.547563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171712-a01c-44c2-8019-86943b5f6d47 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.548552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171712-a01c-44c2-8019-86943b5f6d47 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.549315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171712-a01c-44c2-8019-86943b5f6d47 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.551996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 15/33] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:09.557987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.558466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.558537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.577154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d24467-4fba-4e81-98b6-26ce459290e1 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.577424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d24467-4fba-4e81-98b6-26ce459290e1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.577677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d24467-4fba-4e81-98b6-26ce459290e1 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.579922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 16/34] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:09.590069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:09.591716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:09.595501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.596116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.596602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.625951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:09.627867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:09.705079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 17/35] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:09.720247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 19/36] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:09.738194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:09.747190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821f92-79b7-4033-974b-5262a5356187 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:09.749403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:09.758712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:09.758951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6e956-0917-4760-9ca5-8db9e14ea8a1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:09.759469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.759759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.760045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.760835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:09.762188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:09.762188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:09.762188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:09.763152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace43f40-348b-455d-914d-68d4ebfe0265 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:09.765255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:09.765961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.766305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.766589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.767457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:09.768793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:09.768793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:09.768793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:09.769742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876623eb-ce86-4232-b851-56c72b16a08a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:09.789050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:28:09 2021] POST /identity/v3/roles => generated 219 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:09.800057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 20/38] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:28:09 2021] POST /identity/v3/roles => generated 225 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:09.825752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928ee7-056f-4134-9ed6-3f0aadc60224 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.826081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928ee7-056f-4134-9ed6-3f0aadc60224 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.826330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928ee7-056f-4134-9ed6-3f0aadc60224 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.828328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 19/39] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:09.835088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae315d-34cb-411a-8ff1-26a8e5eddfcd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.835414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae315d-34cb-411a-8ff1-26a8e5eddfcd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.835656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae315d-34cb-411a-8ff1-26a8e5eddfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.864786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c7ae315d-34cb-411a-8ff1-26a8e5eddfcd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:09.866367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c7ae315d-34cb-411a-8ff1-26a8e5eddfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:09.883205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 21/40] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:09.925964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88928ee7-056f-4134-9ed6-3f0aadc60224 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:09.944748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88928ee7-056f-4134-9ed6-3f0aadc60224 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:09.952405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ad0e9-2694-46f4-a952-506c5acca302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:09.953416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ad0e9-2694-46f4-a952-506c5acca302 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:09.953712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ad0e9-2694-46f4-a952-506c5acca302 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:09.953993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ad0e9-2694-46f4-a952-506c5acca302 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:09.954855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ad0e9-2694-46f4-a952-506c5acca302 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:09.956663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ad0e9-2694-46f4-a952-506c5acca302 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:09.981525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:28:09 2021] POST /identity/v3/roles => generated 223 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:10.242300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb33f31-3fb9-492c-b87d-f991f19c7c63 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:10.242693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb33f31-3fb9-492c-b87d-f991f19c7c63 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:10.243072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb33f31-3fb9-492c-b87d-f991f19c7c63 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:10.244953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 22/42] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:10.250384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:10.250673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:10.250983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:10.268764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:10.269998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:10.278035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 21/43] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:10.302045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb33f31-3fb9-492c-b87d-f991f19c7c63 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:10.315627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb33f31-3fb9-492c-b87d-f991f19c7c63 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:10.320622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e986c-ed2a-4587-ab37-ab25f745e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:10.321390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e986c-ed2a-4587-ab37-ab25f745e8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:10.321621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e986c-ed2a-4587-ab37-ab25f745e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:10.321898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e986c-ed2a-4587-ab37-ab25f745e8d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:10.323064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e986c-ed2a-4587-ab37-ab25f745e8d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:10.326086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e986c-ed2a-4587-ab37-ab25f745e8d3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:10.329191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 23/44] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:10.335797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:10.345409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8772e1-17f1-4289-a4a8-c6485c473aa4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:10.349727 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ac008-ec62-4c66-8508-4fa69618f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:10.350386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ac008-ec62-4c66-8508-4fa69618f43a admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:10.350669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ac008-ec62-4c66-8508-4fa69618f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:10.350983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ac008-ec62-4c66-8508-4fa69618f43a admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:10.351698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ac008-ec62-4c66-8508-4fa69618f43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:10.353738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ac008-ec62-4c66-8508-4fa69618f43a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:10.390948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:28:10 2021] POST /identity/v3/projects => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:11.854258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c7d2-ab18-4f10-ad27-240ffd8ff8ba None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:11.854946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c7d2-ab18-4f10-ad27-240ffd8ff8ba None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:11.854946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c7d2-ab18-4f10-ad27-240ffd8ff8ba None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:11.856748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 24/46] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:11.862888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:11.863706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:11.863706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:11.882898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:11.884290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:11.946158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 23/47] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:11.970997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c7d2-ab18-4f10-ad27-240ffd8ff8ba None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:11.983278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c7d2-ab18-4f10-ad27-240ffd8ff8ba None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:11.987440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:11.988241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:11.988532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:11.988813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.000589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:12.008259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:12.009627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:12.016006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:12.026071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e61724-0d94-4b6f-828d-c57d5508f155 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:12.030308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:12.031013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.031305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.031586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.032481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:12.032789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:12.033968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:12.033968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:12.033968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:12.034902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:12.049387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 24/49] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:12.055902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:12.066080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084311-5500-4b69-a581-c3aef9fbd9d9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:12.070944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:12.071825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.072105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.072462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.073547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:12.075544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:12.077125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 26/50] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:12 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:12.082784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:12.092127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e64eb-9a29-4bbd-b775-500a9ec662cc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:12.096322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04836732-03ae-45e1-92be-f3cac6e3e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:12.097112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04836732-03ae-45e1-92be-f3cac6e3e820 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.097395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04836732-03ae-45e1-92be-f3cac6e3e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.097669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04836732-03ae-45e1-92be-f3cac6e3e820 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.098899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04836732-03ae-45e1-92be-f3cac6e3e820 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:12.100643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04836732-03ae-45e1-92be-f3cac6e3e820 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:12.102191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 25/51] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:12.108170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:12.117934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6d44-45cc-401b-b517-50bbaf83e82d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:12.122080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:12.122717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.123032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.123311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.124136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.domain.id=default, user.id=fe1a2ced475c48049c83dfdc6c90aecc) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:12.124445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:12.125442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:12.125442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:12.125442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:12.126613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c80da2-ea9d-413d-ac11-71b76b743ea2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:12.134430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 27/52] 10.222.0.66 () {56 vars in 1344 bytes} [Tue Jul 13 08:28:12 2021] GET /identity/v3/role_assignments?user.id=fe1a2ced475c48049c83dfdc6c90aecc&scope.domain.id=default&role.id=620fb448cda4468da4c7442522368bea => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:12.565817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f602b-97b0-47c9-bcdd-e6bc57a6fe2e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.566107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f602b-97b0-47c9-bcdd-e6bc57a6fe2e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.566378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f602b-97b0-47c9-bcdd-e6bc57a6fe2e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.568220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 26/53] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:12.573686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.573987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.574277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.592148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:12.593318 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:12.601238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 28/54] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:12.625630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f602b-97b0-47c9-bcdd-e6bc57a6fe2e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:12.639968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f602b-97b0-47c9-bcdd-e6bc57a6fe2e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:12.644628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de8107-d0d6-45c5-9541-4d08087077c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:12.645804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de8107-d0d6-45c5-9541-4d08087077c4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.646095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de8107-d0d6-45c5-9541-4d08087077c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.646374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de8107-d0d6-45c5-9541-4d08087077c4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.647581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de8107-d0d6-45c5-9541-4d08087077c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:12.649291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de8107-d0d6-45c5-9541-4d08087077c4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:12.650854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:12.656703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:12.670790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327df97-ec2f-469d-a47b-12b46f7c6615 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:12.674966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:12.675629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:12.675915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:12.676191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:12.677536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:12.678572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:12.678572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:12.678572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:12.679910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa15d24-afb2-4b57-a476-465b3e24cea9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:12.706613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 29/56] 10.222.0.66 () {60 vars in 1162 bytes} [Tue Jul 13 08:28:12 2021] POST /identity/v3/projects => generated 298 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:14.884424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef782a-d499-48f7-95b9-54b00fea757e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:14.884969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef782a-d499-48f7-95b9-54b00fea757e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:14.884969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef782a-d499-48f7-95b9-54b00fea757e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:14.886731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 28/57] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:14.892745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:14.893269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:14.893354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:14.912561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:14.913787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:14.973516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 30/58] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:14.999621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef782a-d499-48f7-95b9-54b00fea757e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:15.011101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef782a-d499-48f7-95b9-54b00fea757e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:15.015108 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea74a-373c-42a6-b4c7-39d3cd2f97f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:15.015897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea74a-373c-42a6-b4c7-39d3cd2f97f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:15.016182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea74a-373c-42a6-b4c7-39d3cd2f97f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:15.016460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea74a-373c-42a6-b4c7-39d3cd2f97f5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:15.017586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea74a-373c-42a6-b4c7-39d3cd2f97f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:15.019335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea74a-373c-42a6-b4c7-39d3cd2f97f5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:15.021661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:15.027237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:15.038395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17615-e3c3-491f-84f2-e6e9dfbd5999 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:15.043836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:15.044504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:15.044793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:15.045071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:15.045787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:15.046799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:15.046799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:15.046799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:15.048091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bb2be-fe95-4d40-88fd-acb78cbdf44d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:15.074365 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 31/60] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:15 2021] POST /identity/v3/users => generated 275 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:18.683734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af975c-26d2-471b-9341-1d6a8347f8bb None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.684785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af975c-26d2-471b-9341-1d6a8347f8bb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.685271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af975c-26d2-471b-9341-1d6a8347f8bb None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.687746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 30/61] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:18.693741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.694664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.695183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.718331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed2316-765f-4f17-8ed9-b195e3799078 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.718969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed2316-765f-4f17-8ed9-b195e3799078 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.719464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed2316-765f-4f17-8ed9-b195e3799078 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.721679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 31/62] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:18.726144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:18.726698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.727243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.727607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:18.727965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.749221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 32/63] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:18.753535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:18.755246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:18.773737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.782707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8881791-1c9e-4ed5-923d-4542272be2f1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.783958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 32/64] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:18.793793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.794876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.795412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.795881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.809363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.818409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15046dcb-b3f3-4629-a28d-8e419be27e53 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.821583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:18.829560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:18.832493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.834171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.834667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.835170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.844124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 33/65] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:18.847157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.860298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:18.869485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:18.872137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bf20d-1d3e-4a30-bd8b-ad284973da13 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.875686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 33/66] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:18.881711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.882627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.883364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.883655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.883940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.884720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:18.885033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:18.886685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ba7bb-e63b-4fa3-ad96-85327e99aee5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:18.896886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70816153-811d-454e-a868-ef7ffb6c2125 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.897596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 34/67] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:18.902461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40608a6c-324d-4649-b4c6-5ec0e89de9fa None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.902461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40608a6c-324d-4649-b4c6-5ec0e89de9fa None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.902461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40608a6c-324d-4649-b4c6-5ec0e89de9fa None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.902923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 35/68] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:18.903789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40608a6c-324d-4649-b4c6-5ec0e89de9fa None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.908490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.909170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.909454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.909730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.910494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:18.911459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:18.913349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83f70e-e3e6-4216-a262-7d4e6ad92e4f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:18.925895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:18.928044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.928333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.928608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.929107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40608a6c-324d-4649-b4c6-5ec0e89de9fa None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.934223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.936546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.937138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.937565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.948550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:18.949918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:18.958400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 35/70] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:18.959672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.963295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:18.965873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:18.971764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:18.976647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715947-a9d0-4b35-883c-e41c0f05bb92 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.978402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:18.989492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2ced-0bd6-442f-a49a-f43773dea093 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:18.991873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.992767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.993146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.993517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.994227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838fb8c-36d8-4d39-be9a-25446303a7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:18.994667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:18.994878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838fb8c-36d8-4d39-be9a-25446303a7ec admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:18.995190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838fb8c-36d8-4d39-be9a-25446303a7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:18.995465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838fb8c-36d8-4d39-be9a-25446303a7ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:18.996577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:18.998281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 36/72] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:18.998983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.003678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838fb8c-36d8-4d39-be9a-25446303a7ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.006107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838fb8c-36d8-4d39-be9a-25446303a7ec admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.009767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f638fe-a599-407e-9461-a4615bd350ca admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.014178 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.014409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 37/73] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:19.015720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a1e5-4c39-42bb-b70a-4220f1257eab None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.016011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a1e5-4c39-42bb-b70a-4220f1257eab None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.016290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a1e5-4c39-42bb-b70a-4220f1257eab None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.018144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 38/74] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:19.019023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a1e5-4c39-42bb-b70a-4220f1257eab None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.019124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.020465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.020465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.030803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a1e5-4c39-42bb-b70a-4220f1257eab None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.032030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:19.035898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ee0b1-16d8-4cb9-ad40-4e29a744d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.036738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ee0b1-16d8-4cb9-ad40-4e29a744d9be admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.037165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ee0b1-16d8-4cb9-ad40-4e29a744d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.037582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ee0b1-16d8-4cb9-ad40-4e29a744d9be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.039226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:19.040437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:19.041213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.046330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ee0b1-16d8-4cb9-ad40-4e29a744d9be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.048306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ee0b1-16d8-4cb9-ad40-4e29a744d9be admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.054763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f258e0-df32-4543-b1b3-defb5d48bf26 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.057806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 39/76] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:19.062342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.062342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.062342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.062539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.062604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.062678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.062678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.062792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.063682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.065406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 38/77] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.071238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.079085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:19.079484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd23a-2c4c-4b9f-bbec-e4b6815d47cb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.080232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:19.083839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.084506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.084800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.085083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.085832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:19.086145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.094964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.095094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 40/78] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:19.095094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.096401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 39/79] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.097206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.108306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd3de3-b770-4b4d-ae93-607d75f89002 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.110941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211f37-7a89-4a5c-9baf-9a9e3291dfa9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.113247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.114243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.114533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.114808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.115960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.116056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.116655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.116943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.117227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.118061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.118150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] RBAC: Adding query filter params (role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=58c7199938d943d7a31ec342ea304e39, user.id=185aae3d3ca24853b301af03d83f7546) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:19.118375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.120690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 41/80] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.120794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.120860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.126159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 40/81] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/role_assignments?user.id=185aae3d3ca24853b301af03d83f7546&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.127808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.138172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640ed4-230c-4e15-9624-03ebacc0d134 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.140649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417ae0d-89a7-429d-8d7e-c8a621f3d565 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.143297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.144573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.144972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.145796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.146484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.147379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.147775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.148201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.148650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.149725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.150369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.151738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 41/82] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.153179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.157762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.159102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 42/83] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.160276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.170219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1d37-a60d-48b5-8f93-428a916cb114 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.173973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e544ad1-aa53-4667-8f6f-771c2325c16e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.174758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.175634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.175988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.176886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.178159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=58c7199938d943d7a31ec342ea304e39, user.id=fe1a2ced475c48049c83dfdc6c90aecc) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:19.178556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.180367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f550c68-e00d-4676-a147-01ed4ebc8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.180997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.181542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f550c68-e00d-4676-a147-01ed4ebc8094 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.182142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f550c68-e00d-4676-a147-01ed4ebc8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.182746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f550c68-e00d-4676-a147-01ed4ebc8094 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.184182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f550c68-e00d-4676-a147-01ed4ebc8094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.187476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f550c68-e00d-4676-a147-01ed4ebc8094 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.187761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 42/84] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/role_assignments?user.id=fe1a2ced475c48049c83dfdc6c90aecc&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.195192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.213274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0cc9-d264-4b29-b0ac-96fcca0627e3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.222395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.223378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.223666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.224457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.234436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.240103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 43/85] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:28:19 2021] POST /identity/v3/projects => generated 302 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:19.243892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec846c-219c-4b1d-ba74-6c6c8869d014 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.244259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec846c-219c-4b1d-ba74-6c6c8869d014 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.244612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec846c-219c-4b1d-ba74-6c6c8869d014 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.245684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.246674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 44/86] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:19.253243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.253532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.254082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.259479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 43/87] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:19.265895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.277192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb680d-df52-4dce-a4ca-6793b8a8c4b0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.282776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:19.284472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:19.342198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.343255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.343813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.344312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.345762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.348414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.350657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 44/88] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:19.355190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 45/89] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:19.365308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.375332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765883e-2453-4c9b-b1b9-5ccac77fb568 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.381890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.382830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.383568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.383853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.384185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.385053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] RBAC: Adding query filter params (role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=58c7199938d943d7a31ec342ea304e39, user.id=185aae3d3ca24853b301af03d83f7546) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:19.385368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.387376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.392687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1396-733d-4984-942e-cc925382bbb9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.393717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 45/90] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/role_assignments?user.id=185aae3d3ca24853b301af03d83f7546&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.399750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.401092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.401643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.402236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.416833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:19.424610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:19.426377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 46/91] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:19.434646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.449753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977742c4-5df3-4d62-bf9c-650d47e83a66 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.454719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.455855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.456345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.456821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.458470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:19.459082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.461115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.473288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 46/92] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.479526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.490600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df504-0b08-4653-a337-e4caa3c37a04 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.496455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.497749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.498243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.498790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.500504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.503032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.506147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 47/93] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.511720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.527862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618339-2568-4fbb-8aea-16ed31cd76e1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.538161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.539984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.540833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.541653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.572770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.576456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.607045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 47/94] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:19.615352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.632906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa06ad7-fcad-40b3-bfd3-9c4e06ecf44a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.643678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cdb63-01cd-428a-af14-211405b8a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.646981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdb63-01cd-428a-af14-211405b8a076 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.647824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdb63-01cd-428a-af14-211405b8a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.648616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdb63-01cd-428a-af14-211405b8a076 admin admin] PATH_INFO: `/v3/projects/a66f8c5a14ca4f92860217a228c3a825` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.651182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cdb63-01cd-428a-af14-211405b8a076 admin admin] RBAC: Authorizing `identity:get_project(project_id=a66f8c5a14ca4f92860217a228c3a825)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.655218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cdb63-01cd-428a-af14-211405b8a076 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.658632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 48/95] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/projects/a66f8c5a14ca4f92860217a228c3a825 => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:19.667761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:19.678876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb35fc5-bbc6-4722-b50b-cf6a83487b6d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:19.691762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:19.693164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:19.693386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:19.693668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:19.694529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] RBAC: Adding query filter params (role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=a66f8c5a14ca4f92860217a228c3a825, user.id=185aae3d3ca24853b301af03d83f7546) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:19.694845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:19.696780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa279d-74d9-454f-b6c0-182b42a8786e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:19.707504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 48/96] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:19 2021] GET /identity/v3/role_assignments?user.id=185aae3d3ca24853b301af03d83f7546&scope.project.id=a66f8c5a14ca4f92860217a228c3a825&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:21.877022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e685e-daa4-4dd6-9324-443fc730f645 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:21.878084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e685e-daa4-4dd6-9324-443fc730f645 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:21.878590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e685e-daa4-4dd6-9324-443fc730f645 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:21.880770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 49/97] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:21.886905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cd8d-a36e-4497-bb98-e2461a2cf026 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:21.887455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cd8d-a36e-4497-bb98-e2461a2cf026 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:21.887537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cd8d-a36e-4497-bb98-e2461a2cf026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:21.913300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-df59cd8d-a36e-4497-bb98-e2461a2cf026 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:21.914525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-df59cd8d-a36e-4497-bb98-e2461a2cf026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:21.925177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 49/98] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:21.941664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ed75c-02c2-4d7b-b670-1a3f2bd164f5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:21.942748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ed75c-02c2-4d7b-b670-1a3f2bd164f5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:21.943111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ed75c-02c2-4d7b-b670-1a3f2bd164f5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:21.945004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 50/99] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:21.950853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:21.951178 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:21.951482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:21.955345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ed75c-02c2-4d7b-b670-1a3f2bd164f5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:21.974001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ed75c-02c2-4d7b-b670-1a3f2bd164f5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:21.983603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:21.984537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:21.985938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:21.987123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:21.987630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:21.989531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.005415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 50/100] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:22.009876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:22.017055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:22.018593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 51/101] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:22.025068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.033414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.036385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d028-ba6d-43e5-b193-4a170682b44f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.046330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.047070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.047365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.047649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.048431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:22.048746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.050494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.054026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40015bb0-57ff-40df-b78e-639a93760597 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.065246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 51/102] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.066506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.067921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.068201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.068586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.075578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.088359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903ce8e-471f-4ea3-a5eb-3574aabdcb62 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.093235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:22.101091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:22.102382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 52/103] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:22.109665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.111144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.112066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.112346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.112622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.114560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.116696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.119127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 52/104] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.124854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.127102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771fcda-8173-4acc-b7ec-630ca771c2be admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.137283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12266d-96cc-4cb2-a318-4301f3ce52d2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.143001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.143726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.144017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.144298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.144474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfd5a2-103c-4944-9d23-35075c17e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.145356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:22.145667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.146444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd5a2-103c-4944-9d23-35075c17e5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.146940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd5a2-103c-4944-9d23-35075c17e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.147332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.147625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd5a2-103c-4944-9d23-35075c17e5e0 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.149067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfd5a2-103c-4944-9d23-35075c17e5e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.151409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfd5a2-103c-4944-9d23-35075c17e5e0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.158067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 53/105] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.158067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165afb-c1f5-4b0c-990f-0d79f938fca1 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.158067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165afb-c1f5-4b0c-990f-0d79f938fca1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.158067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165afb-c1f5-4b0c-990f-0d79f938fca1 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.159000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 54/106] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:22.160167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf77540-d3e4-4c6e-a1b0-9f48c89c03fb None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.160454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf77540-d3e4-4c6e-a1b0-9f48c89c03fb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.161271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf77540-d3e4-4c6e-a1b0-9f48c89c03fb None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.161922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 53/107] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.162876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 55/108] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:22.163040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.170015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.170369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.170655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.177259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118e2ef-f2ad-4c5d-96d9-fd0d58a05629 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.185962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f0d99-347e-4802-9451-48d5b84f67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.186844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f0d99-347e-4802-9451-48d5b84f67c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.187170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f0d99-347e-4802-9451-48d5b84f67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.187445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f0d99-347e-4802-9451-48d5b84f67c4 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39/users/fe1a2ced475c48049c83dfdc6c90aecc/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.188770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:22.189241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f0d99-347e-4802-9451-48d5b84f67c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7199938d943d7a31ec342ea304e39, user_id=fe1a2ced475c48049c83dfdc6c90aecc, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.189930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:22.192508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f0d99-347e-4802-9451-48d5b84f67c4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.198730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 56/109] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:22.199582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.211578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 54/110] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:22 2021] PUT /identity/v3/projects/58c7199938d943d7a31ec342ea304e39/users/fe1a2ced475c48049c83dfdc6c90aecc/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:22.212016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dde01-3fe2-4f46-adaa-0025922649de None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.213724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.214276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.214788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.241382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:22.241382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:22.285528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.286678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.287180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.287620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.289030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.291508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.293456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 57/111] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.294649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.308109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b2196-0c3d-45c2-8f95-e170bde65f65 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.309961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 55/112] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:22.311064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.320985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1f3d-befe-4bd5-8690-5fa257ae4780 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.325610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.326726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.327208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.327639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.327764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.328499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.328794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.329074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.329566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.332225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.334979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 56/113] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.344582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.356285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bc0f-3c79-474a-ae0a-00d1c0dd3107 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.356621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:22.361167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.362297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.362738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.363236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39/users/185aae3d3ca24853b301af03d83f7546/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.364319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:22.365566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7199938d943d7a31ec342ea304e39, user_id=185aae3d3ca24853b301af03d83f7546, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.365693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 58/114] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:22.366414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.368925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.379060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9a395-5a46-4867-8cef-4cd24ccf7f1a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.384588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.385471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.385747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.386019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.387343 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.389206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.389503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 57/115] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:22 2021] PUT /identity/v3/projects/58c7199938d943d7a31ec342ea304e39/users/185aae3d3ca24853b301af03d83f7546/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:22.390573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.391214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 59/116] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.398202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.412063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b26531-1381-47dd-8aab-85152d9ffeac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.480743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4061-232f-4a16-adee-f0a7df946a2c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.486041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.486723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.487039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.487321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.487909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.488109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:22.488397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.488575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.489402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.489688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.490394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.490625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7dafa-c926-4367-8c8e-c8bf99622c2e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.491448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:22.491448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:22.491448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:22.492700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.501797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 58/117] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.501797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e9e00-d20b-4f46-a41d-bf4c3001104f None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.501797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e9e00-d20b-4f46-a41d-bf4c3001104f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.501797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e9e00-d20b-4f46-a41d-bf4c3001104f None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.507256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 59/118] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:22.508225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e9e00-d20b-4f46-a41d-bf4c3001104f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.523909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e9e00-d20b-4f46-a41d-bf4c3001104f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.528788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b319-b0df-4ba3-a315-66b1d18fb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.529671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b319-b0df-4ba3-a315-66b1d18fb61f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.529963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b319-b0df-4ba3-a315-66b1d18fb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.530246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b319-b0df-4ba3-a315-66b1d18fb61f admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.531612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08b319-b0df-4ba3-a315-66b1d18fb61f admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.534060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08b319-b0df-4ba3-a315-66b1d18fb61f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.536310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 60/119] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.542943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 60/120] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:22 2021] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:22.543183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.543183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.543183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.550361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.571794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e59a9-2994-471f-9b65-22311d5acdb4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.588116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.589059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.589404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.589693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.591400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:22.592215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.594836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:22.596938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.600057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 61/121] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:22.606989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.613390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 61/122] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:22.622505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ccd7e-2be9-476a-841c-34922b33a153 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.631372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.632419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.632804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.633185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39/users/185aae3d3ca24853b301af03d83f7546/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.637907 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7199938d943d7a31ec342ea304e39, user_id=185aae3d3ca24853b301af03d83f7546, role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.639301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:22.639301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:22.639301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:22.641711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.644833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.656296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90d78-a4bc-4779-8c42-7fe1c0068210 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.662557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.663563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.663952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.664324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.669921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 62/123] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:22 2021] PUT /identity/v3/projects/58c7199938d943d7a31ec342ea304e39/users/185aae3d3ca24853b301af03d83f7546/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:22.683163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:22.691746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:22.693467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 62/124] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:22.700120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.774253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6dd2-928f-49ca-acd0-cfd00332e4e1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.779202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.780102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.780600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.781040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.782000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:22.782464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.784323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.794858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 63/125] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.802978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.812709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e6784-e422-45d2-98e0-e6a06a3f12b7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.821245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.822296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.822676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.823100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.824425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.826748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.829070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 63/126] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.835425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.847644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766391-e7b3-4ab8-9dbb-acfcd5fe18ab admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.856375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23313c9-f58a-411f-b4a4-18f29e30fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.857560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23313c9-f58a-411f-b4a4-18f29e30fdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.858015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23313c9-f58a-411f-b4a4-18f29e30fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.858502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23313c9-f58a-411f-b4a4-18f29e30fdd0 admin admin] PATH_INFO: `/v3/projects/a66f8c5a14ca4f92860217a228c3a825` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.860528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23313c9-f58a-411f-b4a4-18f29e30fdd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a66f8c5a14ca4f92860217a228c3a825)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.863159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23313c9-f58a-411f-b4a4-18f29e30fdd0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.865307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 64/127] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:22 2021] GET /identity/v3/projects/a66f8c5a14ca4f92860217a228c3a825 => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:22.872832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:22.885587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c042f-bf9c-4d1d-aa92-cd12de0ce3be admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:22.890720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca864b-0781-48ed-9123-ad229cee1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:22.891736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca864b-0781-48ed-9123-ad229cee1cab admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:22.892093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca864b-0781-48ed-9123-ad229cee1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:22.892459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca864b-0781-48ed-9123-ad229cee1cab admin admin] PATH_INFO: `/v3/projects/a66f8c5a14ca4f92860217a228c3a825/users/185aae3d3ca24853b301af03d83f7546/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:22.894450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca864b-0781-48ed-9123-ad229cee1cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66f8c5a14ca4f92860217a228c3a825, user_id=185aae3d3ca24853b301af03d83f7546, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:22.898410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca864b-0781-48ed-9123-ad229cee1cab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:22.913428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 64/128] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:22 2021] PUT /identity/v3/projects/a66f8c5a14ca4f92860217a228c3a825/users/185aae3d3ca24853b301af03d83f7546/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:28:25.192780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb5a0-f0eb-4cef-a1f8-84d36c4e54a3 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.193416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb5a0-f0eb-4cef-a1f8-84d36c4e54a3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.193558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb5a0-f0eb-4cef-a1f8-84d36c4e54a3 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.195507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 65/129] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:25.201091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.201986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.202448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.231895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:25.233341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:25.310838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 65/130] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:25.352000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cb5a0-f0eb-4cef-a1f8-84d36c4e54a3 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.368882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cb5a0-f0eb-4cef-a1f8-84d36c4e54a3 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.378885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.380302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.380590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.380895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.403965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:25.411070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:25.412335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 66/131] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:25.418493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.427253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaab60-1491-4660-9c5f-fe2c0221be8a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.438100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.438784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.439105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.439387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.440209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:25.440529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.442718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.455243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 66/132] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.461836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.476002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639a24b-d5e9-43dd-95d0-2d70a9381918 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.482806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.483721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.484010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.484293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.485475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.487387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.489655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 67/133] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.496375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.512549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45ebb1-3225-4b75-a845-45bc1ff2d385 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.516930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.517586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.517873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.518152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.530857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.532693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.547455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 67/134] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:25.553996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.572360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc2768-2c44-4c05-a887-23f6498f3737 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.584046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484496e-ff9e-49d6-add3-15855358a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.584955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484496e-ff9e-49d6-add3-15855358a25b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.585247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484496e-ff9e-49d6-add3-15855358a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.585532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484496e-ff9e-49d6-add3-15855358a25b admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.586765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484496e-ff9e-49d6-add3-15855358a25b admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.593037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484496e-ff9e-49d6-add3-15855358a25b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.595151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 68/135] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.603403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.612069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232edeb5-e11f-4913-a252-ea5f7329e1e4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.623258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.623938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.624225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.624501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.625347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=58c7199938d943d7a31ec342ea304e39, user.id=fe1a2ced475c48049c83dfdc6c90aecc) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:25.625657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.627584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db461263-a17a-422d-b230-0691b484c8f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.634487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 68/136] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/role_assignments?user.id=fe1a2ced475c48049c83dfdc6c90aecc&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.677694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735dd17-87b8-4df9-ab05-b856dd34ee28 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.678002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735dd17-87b8-4df9-ab05-b856dd34ee28 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.678256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735dd17-87b8-4df9-ab05-b856dd34ee28 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.680088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 69/137] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:25.685912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.686217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.686472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.712153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:25.713281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:25.724538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 69/138] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:25.769665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735dd17-87b8-4df9-ab05-b856dd34ee28 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.785007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735dd17-87b8-4df9-ab05-b856dd34ee28 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.792597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.793420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.793713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.793994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.809826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:25.817539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:25.818806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 70/139] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:25.824999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.834065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1861af-4dec-4824-a07a-7faa4287c3a3 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.842787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.843514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.843806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.844092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.844864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:25.845185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.846852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.864218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 70/140] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.870171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.881770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d710-0342-42f0-bd12-3243b6c6ef79 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.892902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.893805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.894092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.894372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.896543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.898758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.900437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 71/141] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.906365 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.920052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5bb25-0641-4773-9f77-cae95f51f8d9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.927665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.928356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.928646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.928929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.937511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.939354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.952743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 71/142] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:25.959246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:25.969538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21cc5-5db6-4e03-831a-770840b10151 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:25.979217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f322-805f-436a-a549-9880cdc4d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:25.980097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f322-805f-436a-a549-9880cdc4d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:25.980389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f322-805f-436a-a549-9880cdc4d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:25.980672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f322-805f-436a-a549-9880cdc4d0e2 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:25.981887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f322-805f-436a-a549-9880cdc4d0e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:25.984119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f322-805f-436a-a549-9880cdc4d0e2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:25.986146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 72/143] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:25.992331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.001158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f2a42-6b77-47a6-bbb4-a568e535fc43 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.007099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.007805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.008090 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.008373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.009227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] RBAC: Adding query filter params (role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=58c7199938d943d7a31ec342ea304e39, user.id=185aae3d3ca24853b301af03d83f7546) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:26.009638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.011583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236690-6182-43c6-ac79-476b68063966 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.025300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 72/144] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:25 2021] GET /identity/v3/role_assignments?user.id=185aae3d3ca24853b301af03d83f7546&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:26.500981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97bc00-f24d-4b7b-b41d-2ded9d755494 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.501632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97bc00-f24d-4b7b-b41d-2ded9d755494 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.501632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97bc00-f24d-4b7b-b41d-2ded9d755494 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.503627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 73/145] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:26.521249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.521870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.521870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.531792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ab92-dd41-44c8-9565-aa7d768192ce None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.531792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ab92-dd41-44c8-9565-aa7d768192ce None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.533003 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ab92-dd41-44c8-9565-aa7d768192ce None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.540239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 74/146] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:26.549961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:26.551531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:26.555721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.556036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.556300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.560754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 73/147] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:26.585254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:26.586432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:26.600081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 75/148] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:26.606056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.615164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3eb06-9fe3-443b-a6b9-8acfb0f8248a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.627277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.628105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.628390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.628666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.645360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:26.645630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.652391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:26.653892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 74/149] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:26.659614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.661059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dad71-7268-491e-8a59-2b0ff047430e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.669854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453675c9-ae71-41c6-a3cf-5a351a3f168b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.671626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.672470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.672762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.673044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.687762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.688465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.688754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.689035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.689806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:26.690117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.692376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.702410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 75/150] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:26.704009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:26.708748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.712185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:26.713442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 76/151] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:26.719654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.728237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4020-8979-4fb3-852f-5ff2a14fa8df admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.734537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a038012-7bab-4cb8-b4fb-35f0409218d1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.737567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.738595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.738900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.739202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.740719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.743067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.745008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 76/152] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:26.746903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.747654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.747943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.748475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.749352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:26.750838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.756473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.758244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.769027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54716d5f-baf4-4422-8e22-51b50118841d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.776957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 77/153] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:26.778358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.778891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.779206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.779625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.784056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.805434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.807486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.813495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9531-9830-4d4c-8572-97c63c437391 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.818603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.819570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.819890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.820176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.821826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.826868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.828690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 78/154] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:26.834786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 77/155] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:26.835652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.843777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.854578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfd912-1c62-4265-bf22-61ab78c15ab5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.856841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca827cd8-ffdc-40b1-a1ec-d8427c77cf1d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.861911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.862791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.863118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.863405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] PATH_INFO: `/v3/projects/a66f8c5a14ca4f92860217a228c3a825` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.867994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.868665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.868949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.869229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.870615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] RBAC: Authorizing `identity:get_project(project_id=a66f8c5a14ca4f92860217a228c3a825)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.872775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.874518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 78/156] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/projects/a66f8c5a14ca4f92860217a228c3a825 => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:26.884030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.896174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.898028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.906161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b444ac-d177-452d-a94e-a47628244ed6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.912761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.913571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.913851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.914132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.915004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] RBAC: Adding query filter params (role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=a66f8c5a14ca4f92860217a228c3a825, user.id=185aae3d3ca24853b301af03d83f7546) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:26.915324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.917238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.922007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 79/157] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:26.928682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.941314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 79/158] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/role_assignments?user.id=185aae3d3ca24853b301af03d83f7546&scope.project.id=a66f8c5a14ca4f92860217a228c3a825&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:26.943176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c92c-bdb7-44c6-bae6-47b60392018e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.947473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5470bb-3b16-4453-a0a9-7095a60a2a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.948429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5470bb-3b16-4453-a0a9-7095a60a2a6d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.948714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5470bb-3b16-4453-a0a9-7095a60a2a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.948990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5470bb-3b16-4453-a0a9-7095a60a2a6d admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.950285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5470bb-3b16-4453-a0a9-7095a60a2a6d admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.956689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5470bb-3b16-4453-a0a9-7095a60a2a6d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.959527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 80/159] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:26.966109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:26.976509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df693b-6e0e-475d-87d6-4c15462a93ac admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:26.987202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:26.987874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:26.988170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:26.988433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:26.989881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] RBAC: Adding query filter params (role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=58c7199938d943d7a31ec342ea304e39, user.id=185aae3d3ca24853b301af03d83f7546) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:26.990203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:26.992125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80853b8d-4514-4324-8281-9aa1c69fb9da admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:26.998998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 80/160] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:26 2021] GET /identity/v3/role_assignments?user.id=185aae3d3ca24853b301af03d83f7546&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.125091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c47b3-09dc-478f-bc2d-ddd7d6bfac00 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.125490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c47b3-09dc-478f-bc2d-ddd7d6bfac00 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.125674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c47b3-09dc-478f-bc2d-ddd7d6bfac00 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.127747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 81/161] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:27.140800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69126997-90ca-4807-b81e-be867a83c75d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.141133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69126997-90ca-4807-b81e-be867a83c75d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.141345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69126997-90ca-4807-b81e-be867a83c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.165282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-69126997-90ca-4807-b81e-be867a83c75d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:27.166446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-69126997-90ca-4807-b81e-be867a83c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:27.178327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 81/162] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:27.225421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c47b3-09dc-478f-bc2d-ddd7d6bfac00 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.249388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c47b3-09dc-478f-bc2d-ddd7d6bfac00 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.259233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.260075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.260356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.260632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.283384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:27.291081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:27.292569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 82/163] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:27.298292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69126997-90ca-4807-b81e-be867a83c75d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.307284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69126997-90ca-4807-b81e-be867a83c75d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.314147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.314147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.314147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.314147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.314514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:27.314828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.316470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.327440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 82/164] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.333080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.343082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a18a6-e2ca-4c84-acee-bdeec3360864 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.348547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.349528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.349895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.350089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.365977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.368341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.370330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 83/165] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.376224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.386716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4141c-fc64-4649-8b63-9ddf17429bed admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.391419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.392140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.392425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.392700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.402147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.404094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.413704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 83/166] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:27.419611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.429242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5b9bf-528b-4e90-859f-8e342ff261cc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.433696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1cbb9-aa65-4ace-b1a5-c4de4019d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.434567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1cbb9-aa65-4ace-b1a5-c4de4019d50d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.434847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1cbb9-aa65-4ace-b1a5-c4de4019d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.435153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1cbb9-aa65-4ace-b1a5-c4de4019d50d admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.436328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1cbb9-aa65-4ace-b1a5-c4de4019d50d admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.438524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1cbb9-aa65-4ace-b1a5-c4de4019d50d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.440287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 84/167] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.448442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.457945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f101-44b0-4a7d-a489-e890456231df admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.462392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.463222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.463505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.463779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.464625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] RBAC: Adding query filter params (role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8, user.id=051cb93831e34e3c87b2534dee3827b6) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:27.464938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.466940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5f314-4683-4033-90c4-2e5e80194484 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.473321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 84/168] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/role_assignments?user.id=051cb93831e34e3c87b2534dee3827b6&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.725690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fde54-b90a-49b2-aaae-0f5b61e1f7df None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.725690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fde54-b90a-49b2-aaae-0f5b61e1f7df None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.725690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fde54-b90a-49b2-aaae-0f5b61e1f7df None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.725690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 85/169] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:27.735343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.735343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.735343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.760227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:27.761769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:27.773003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 85/170] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:27.797254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fde54-b90a-49b2-aaae-0f5b61e1f7df None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.810334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fde54-b90a-49b2-aaae-0f5b61e1f7df None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.815099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.816186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.817404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.817884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.830775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:27.838500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:27.840177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 86/171] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:27.846191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.855515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a81856-b8f8-4a0e-8fa0-6c9db61199b8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.860415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.861428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.861908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.862373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.863949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:27.864476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.866465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.876069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 86/172] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.882647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.893550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761e81-a40e-47c1-858a-39dd7d399868 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.899154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.900414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.900896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.901363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.902807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.904937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.906854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 87/173] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:27.912914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.923204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b510f6-a696-48f4-8e8c-3509e17fe0eb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.928711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbfd9b-64cd-4aa6-aa78-88ef6f2279a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.929915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfd9b-64cd-4aa6-aa78-88ef6f2279a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.930450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfd9b-64cd-4aa6-aa78-88ef6f2279a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.931223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfd9b-64cd-4aa6-aa78-88ef6f2279a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.940713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbfd9b-64cd-4aa6-aa78-88ef6f2279a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.943765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbfd9b-64cd-4aa6-aa78-88ef6f2279a6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.953670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 87/174] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:27.960326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:27.973682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f88c2-4b21-4b9c-bae8-00c3cce46710 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:27.981545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:27.983511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.984385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.985158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.987763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:27.992529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427bb91-d521-4119-8ed9-08fb3af981f5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:27.992766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427bb91-d521-4119-8ed9-08fb3af981f5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:27.993017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427bb91-d521-4119-8ed9-08fb3af981f5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:27.994746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 88/175] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:27.995058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:27.997131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 88/176] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:27 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:28.001943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.001943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.001943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.003369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.014391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76900b67-edca-4522-b9cf-2bf0efa710f5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.018605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.019290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.019571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.020174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.021185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8, user.id=fe1a2ced475c48049c83dfdc6c90aecc) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:28.021516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.023412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.027759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:28.029075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 89/177] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/role_assignments?user.id=fe1a2ced475c48049c83dfdc6c90aecc&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:28.029362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:28.042156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 89/178] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:28.067596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.077558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19c55-1a28-4f87-b1cd-20656343f5c9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.082231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.083317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.083605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.083878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.096573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:28.104834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:28.106253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 90/179] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:28.112690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.123134 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae0d08-9793-45eb-8f93-728951063f77 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.127785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.128576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.128920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.129347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.130238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:28.130557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.132389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ac3f-d193-4721-b536-9de3d17fbf9d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.142152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 90/180] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:28.148325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.158655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255f9e-56e1-419d-8d8e-60d74cff2efc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.164379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.165426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.165713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.165993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.167363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.169807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.171681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 91/181] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:28.174000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3b61-0ffb-4a5f-861d-4d654cd58821 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.174340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3b61-0ffb-4a5f-861d-4d654cd58821 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.174638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3b61-0ffb-4a5f-861d-4d654cd58821 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.177711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 91/182] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:28.178046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.185458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.185778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.186013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.188852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445b75-6385-4044-a30d-41372029c9f1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.193449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.194116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.194402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.194676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.203048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.204852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.207008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:28.208622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:28.215940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 92/183] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:28.220322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.225257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 92/184] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:28.230737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfd35-e111-48d9-aa84-22c8e8da5be1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.234015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.234879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.235272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.235548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.239811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.241863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.248210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 93/185] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:28.252043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.262501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.264560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11125-6280-4d25-b7c1-b7befa0eeb14 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.269117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.270511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.270794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.271098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.271954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] RBAC: Adding query filter params (role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8, user.id=051cb93831e34e3c87b2534dee3827b6) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:28.272268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.274247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94834d-aa98-43a9-a778-ee3571a8dd13 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.274370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.279078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9204-b7ce-4a30-829c-7aacaae286b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.280104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9204-b7ce-4a30-829c-7aacaae286b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.280598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9204-b7ce-4a30-829c-7aacaae286b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.281017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9204-b7ce-4a30-829c-7aacaae286b6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.281186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 93/186] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/role_assignments?user.id=051cb93831e34e3c87b2534dee3827b6&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:28.282642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9204-b7ce-4a30-829c-7aacaae286b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.284684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9204-b7ce-4a30-829c-7aacaae286b6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.286703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 94/187] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:28.293059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:28.303833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f561-5615-4abe-a929-d43305c0f202 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:28.308863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:28.309938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:28.310451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:28.310984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] PATH_INFO: `/v3/groups` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:28.311864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:28.313164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:28.313164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:28.313164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:28.314799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d2acb-fb55-484a-a65e-62f0d5547904 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:28.333494 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 94/188] 10.222.0.66 () {60 vars in 1156 bytes} [Tue Jul 13 08:28:28 2021] POST /identity/v3/groups => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:29.931993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8bdfc-8e64-4394-9ac8-46311d4723de None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:29.933033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8bdfc-8e64-4394-9ac8-46311d4723de None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:29.933523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8bdfc-8e64-4394-9ac8-46311d4723de None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:29.935558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 95/189] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:29.942103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:29.943748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:29.944234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:29.963275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:29.964792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:29.972261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 95/190] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:30.000592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8bdfc-8e64-4394-9ac8-46311d4723de None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.016490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8bdfc-8e64-4394-9ac8-46311d4723de None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.023368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.024759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.025322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.026112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.041778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:30.050464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:30.053256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 96/191] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:30.059690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.069887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af15a-9a6a-46b7-9bd1-7b2a31289116 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.074612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.075604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.076097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.076573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.077574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:30.078097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.080000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.090552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 96/192] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:30.096495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.109560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2ffd-c7c1-4fdc-b3e8-7b8168837dfc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.115002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.116065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.116342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.116617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.117894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.120427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.122378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 97/193] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:30.128562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.139129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fd932-65e5-4a03-8a83-2f54566e0a7e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.143571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416093dc-fc8c-463a-9594-4ea70a8743af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.144449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416093dc-fc8c-463a-9594-4ea70a8743af admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.145282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416093dc-fc8c-463a-9594-4ea70a8743af admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.145666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416093dc-fc8c-463a-9594-4ea70a8743af admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.147081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416093dc-fc8c-463a-9594-4ea70a8743af admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.149244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416093dc-fc8c-463a-9594-4ea70a8743af admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.151335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 97/194] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:30.159433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.178439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071c0e-70be-463b-9990-d97f989f9bc0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.183860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cc27a-0f53-4dd1-9b43-fe03cccb8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.184705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc27a-0f53-4dd1-9b43-fe03cccb8377 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.184994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc27a-0f53-4dd1-9b43-fe03cccb8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.185276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cc27a-0f53-4dd1-9b43-fe03cccb8377 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/users/051cb93831e34e3c87b2534dee3827b6/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.187288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cc27a-0f53-4dd1-9b43-fe03cccb8377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a742d49a1a0413086992eb4fb7cd3d8, user_id=051cb93831e34e3c87b2534dee3827b6, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.190080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cc27a-0f53-4dd1-9b43-fe03cccb8377 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.208505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 98/195] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:30 2021] PUT /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/users/051cb93831e34e3c87b2534dee3827b6/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:30.296962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb871a9-3780-4669-97e8-265729bded5e None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.297370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb871a9-3780-4669-97e8-265729bded5e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.297657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb871a9-3780-4669-97e8-265729bded5e None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.299349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 98/196] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:30.305252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.305630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.305894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.329774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:30.331123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:30.407580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 99/197] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:30.444793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb871a9-3780-4669-97e8-265729bded5e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.459156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb871a9-3780-4669-97e8-265729bded5e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.463738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17632799-9a22-40e1-b336-70672949c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.464775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17632799-9a22-40e1-b336-70672949c0cd admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.465054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17632799-9a22-40e1-b336-70672949c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.465350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17632799-9a22-40e1-b336-70672949c0cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.483434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17632799-9a22-40e1-b336-70672949c0cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:30.490670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-17632799-9a22-40e1-b336-70672949c0cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:30.492369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 99/198] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:30.499540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.513107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0a51-cb17-4013-9eec-32a1e01878a2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.520983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.522036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.522511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.522995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.524045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:30.524583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.525413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546016a-09ea-4a88-a189-2a0a8f690574 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.525922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546016a-09ea-4a88-a189-2a0a8f690574 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.526433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546016a-09ea-4a88-a189-2a0a8f690574 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.527131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.530682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 100/199] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:30 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:30.538843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 100/200] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:30.541555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.541555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.541555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.545375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.559688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b442ac-9186-4dc3-aeab-415b152508b3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.560942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:30.562351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:30.564103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.564980 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.565268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.565548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.567471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.569482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.571419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 101/201] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:30.572669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 101/202] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:30.576880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.587371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b9dd-8d88-497c-a0fd-8a19c0cfed97 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.591835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.592701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.592983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.593263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.594452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.596564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.599102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 102/203] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:30.600785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.608612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.610972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b276a6e-4831-4a5b-977e-169cd9d7ee70 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.616307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009ff4-13c6-49a0-8ce3-ed776fb3a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.617409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009ff4-13c6-49a0-8ce3-ed776fb3a180 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.617990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009ff4-13c6-49a0-8ce3-ed776fb3a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.618467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009ff4-13c6-49a0-8ce3-ed776fb3a180 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.619803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad03c-cdc2-4b13-999b-2d57f6056bb6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.625016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.626086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.626372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.626646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/users/fe1a2ced475c48049c83dfdc6c90aecc/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.629287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a742d49a1a0413086992eb4fb7cd3d8, user_id=fe1a2ced475c48049c83dfdc6c90aecc, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.632281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47009ff4-13c6-49a0-8ce3-ed776fb3a180 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:30.632891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.641076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-47009ff4-13c6-49a0-8ce3-ed776fb3a180 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:30.648287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 103/205] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:30 2021] PUT /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/users/fe1a2ced475c48049c83dfdc6c90aecc/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:28:30.648916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 102/205] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:30.652449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.721140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07137844-3565-4810-8063-feedb7a04aa2 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.721324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07137844-3565-4810-8063-feedb7a04aa2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.721609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07137844-3565-4810-8063-feedb7a04aa2 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.724561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 103/206] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:30.730347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.730647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.730928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.731856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7afd6-7e82-4253-896a-7727a91476b9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.737078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.738737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.739080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.739363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.740201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:30.740518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.742262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.750380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:30.751664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:30.753212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 104/207] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:30.759107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.760718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 104/208] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:30.769475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90c97-c34d-435f-9d61-0ff372a77b46 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.774613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.775546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.775830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.776106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.777341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.779561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.781485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 105/209] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:30.787831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.792214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.800214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c270e6-c390-415c-90af-e4bf99ba8bcf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.803983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834f156-f6a1-4d04-8b89-8ef6be6bb397 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.806618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.807561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.807840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.808115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.809377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.811341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.811624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.812705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.813269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.813775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 105/210] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:30.814291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.816041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.818828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.819749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.826567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 106/211] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:30.828999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:30.831644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4519-d05d-4410-acd3-f0a0429a03a8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.837195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da84924-b0ec-4092-9c37-76aab0a57f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.838115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da84924-b0ec-4092-9c37-76aab0a57f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.838402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da84924-b0ec-4092-9c37-76aab0a57f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.838677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da84924-b0ec-4092-9c37-76aab0a57f6f admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/users/051cb93831e34e3c87b2534dee3827b6/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.841697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da84924-b0ec-4092-9c37-76aab0a57f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a742d49a1a0413086992eb4fb7cd3d8, user_id=051cb93831e34e3c87b2534dee3827b6, role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.842687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19d69a-ab5f-471e-9eb3-ef0698ead225 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:30.844475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da84924-b0ec-4092-9c37-76aab0a57f6f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.848645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:30.849819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:30.850338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:30.850804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] PATH_INFO: `/v3/groups` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:30.851923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:30.853356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:30.853356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:30.853356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:30.854677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6673c-f5cd-41a2-8070-f502075b363c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:30.862781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 106/212] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:30 2021] PUT /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/users/051cb93831e34e3c87b2534dee3827b6/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:28:30.880593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 107/213] 10.222.0.66 () {60 vars in 1156 bytes} [Tue Jul 13 08:28:30 2021] POST /identity/v3/groups => generated 226 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:33.227690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378db66-c71a-4c76-9da6-cdfa1824b1c5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.228673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378db66-c71a-4c76-9da6-cdfa1824b1c5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.229182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378db66-c71a-4c76-9da6-cdfa1824b1c5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.231562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 107/214] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:33.236947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff6777-fa98-4aee-bfb6-c12e970be36b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.237836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff6777-fa98-4aee-bfb6-c12e970be36b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.238844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff6777-fa98-4aee-bfb6-c12e970be36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.273449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-aaff6777-fa98-4aee-bfb6-c12e970be36b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:33.274982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-aaff6777-fa98-4aee-bfb6-c12e970be36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:33.354951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 108/215] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:33.394353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378db66-c71a-4c76-9da6-cdfa1824b1c5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.412823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378db66-c71a-4c76-9da6-cdfa1824b1c5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.419650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.420469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.420879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.421161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.435334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:33.439585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadbf87-7210-48a8-973f-fff7f7d5d03e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.440114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadbf87-7210-48a8-973f-fff7f7d5d03e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.440590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadbf87-7210-48a8-973f-fff7f7d5d03e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.442925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:33.443530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 109/216] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:33.445415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 108/217] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:33.448964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.449531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.450215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.451105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.465107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f1c6a-e82b-4a0c-adea-c2fa29153841 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.474169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.474866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.475178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.475456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.476244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:33.476558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.478304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.483911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:33.485415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:33.492437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 109/218] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:33.497745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.498816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 110/219] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:33.509848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2da47-1be2-473b-b3ba-41173477c220 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.517855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.518751 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.519068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.519346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.527908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.530105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.531839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 110/220] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:33.537635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.544025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.551049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0df0-e1a7-4940-ab2c-695c1ce95009 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.556486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f338-6135-4d49-a523-b638e8abd72a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.560359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.561319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.561803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.562276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.562518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.566934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.566934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.566934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.578876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.581053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.588862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:33.593295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:33.594541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 111/221] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:33.595589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 111/222] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:33.601387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.602133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.612269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ad737-a968-430d-b340-df2ec12d7f42 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.621676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685a54c-7beb-49f7-be17-808e12d7823d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.623593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.624717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.625204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.625674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.627054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.627363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.627737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.628022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.628302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.629125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:33.629441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.631093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.631342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.633343 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 112/223] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:33.639438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.646818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 112/224] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:33.652302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.656900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb21423-4a1e-4d9e-bd77-10afaf873777 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.668489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa15f6c-d34c-47f5-87ae-237c17dfa366 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.668693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.669767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.670278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.670757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.671816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] RBAC: Adding query filter params (role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8, user.id=051cb93831e34e3c87b2534dee3827b6) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:33.672326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.674689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.683798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.684837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.685209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.685528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.687033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.688968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.689649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 113/225] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/role_assignments?user.id=051cb93831e34e3c87b2534dee3827b6&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:33.690740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 113/226] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:33.696583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.712794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43f9f0-4626-4ebb-84da-5694221cea03 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.723705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.724727 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.725229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.725698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.739011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.741216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.757413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 114/227] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:33.763137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.781555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744deda-1649-459d-a9b3-e248676548ee admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.791692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc71d1-c6fe-4b3d-9d9b-51f8b7b30548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.792701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc71d1-c6fe-4b3d-9d9b-51f8b7b30548 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.793079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc71d1-c6fe-4b3d-9d9b-51f8b7b30548 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.793370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc71d1-c6fe-4b3d-9d9b-51f8b7b30548 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.794636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc71d1-c6fe-4b3d-9d9b-51f8b7b30548 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.796841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc71d1-c6fe-4b3d-9d9b-51f8b7b30548 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.798751 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 114/228] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:33.805492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.817438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0d50-a929-4319-9e10-94b82f2e61ae admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.827141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.828239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.828723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.829195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.830255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8, user.id=fe1a2ced475c48049c83dfdc6c90aecc) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:33.830798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:33.833532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b7c3d-c975-4cf9-be51-5af4f084a5dc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:33.844015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 115/229] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/role_assignments?user.id=fe1a2ced475c48049c83dfdc6c90aecc&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:33.846754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5250c-7d5a-4e73-8b08-49b5b95591f4 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.847096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5250c-7d5a-4e73-8b08-49b5b95591f4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.847383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5250c-7d5a-4e73-8b08-49b5b95591f4 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.850411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 115/230] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:33.857046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.857668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.858141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.884121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:33.885719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:33.894273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 116/231] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:33.931910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5250c-7d5a-4e73-8b08-49b5b95591f4 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:33.955340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5250c-7d5a-4e73-8b08-49b5b95591f4 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:33.961084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:33.961978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:33.962262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:33.962542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:33.976135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:33.983330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:33.986573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 116/232] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:33.991340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.008564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc6fb-e4d7-457f-a519-3f1a2709eea5 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.013902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.015135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.015660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.016150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.017188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] RBAC: Adding query filter params (name=member) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:34.017731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.019738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.035382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 117/233] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:34.041409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.057683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bde30-dcba-40fc-9f78-683a6ea4fef6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.066141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.067581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.067868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.068145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.084432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.086401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.098569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 117/234] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:34.104587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.118766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662a513-9fd6-45f3-b62e-772fbb47e35f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.127040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd9cbd-c8ed-44ea-b43a-a800f3c57e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.128281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9cbd-c8ed-44ea-b43a-a800f3c57e70 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.129428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9cbd-c8ed-44ea-b43a-a800f3c57e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.130223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9cbd-c8ed-44ea-b43a-a800f3c57e70 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.135837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd9cbd-c8ed-44ea-b43a-a800f3c57e70 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.138248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd9cbd-c8ed-44ea-b43a-a800f3c57e70 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.140242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 118/235] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:34.146584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.154218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cd6b-8a51-4ce8-b9f7-c12b81841666 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.154787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cd6b-8a51-4ce8-b9f7-c12b81841666 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.155281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cd6b-8a51-4ce8-b9f7-c12b81841666 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.157260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 119/236] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:34.159449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aae90-260e-46dc-9899-4df6030ebeab admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.163335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.163856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.164326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.165206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.169795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.169795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.169795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.180578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.181613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:34.181613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:34.181613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:34.182829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.184569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 118/237] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:34.189771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:34.190959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:34.193628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.203059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 120/238] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:34.208015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c02c6e-ee3b-4c15-9343-288f2e7dd3cf admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.213207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.213865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.214149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.214426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.215295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=58c7199938d943d7a31ec342ea304e39) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:34.215609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.217485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.228722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 119/239] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:34.247685 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.264414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25056e-1f03-4f73-b4c5-441623b66e5f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.275748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.276645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.276977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.277251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.293840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:34.301587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:34.303080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 121/240] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:34.309383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.323188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8c9b2-1a10-498e-a3ab-39ccc2c0a27b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.331259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.332262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.332576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.332860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.333628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:34.333941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.335594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.351910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 120/241] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:34.357440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.371949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e25fa-0f8f-4d66-b72e-cfc65cc2b682 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.377917 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.378882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.379284 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.379526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.380871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.383264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.385320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 122/242] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:34.391021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.405143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60c35-db41-4e37-b0aa-0dbc2a78edf1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.415175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.415848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.416137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.416413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.431188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.432976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.445356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 121/243] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:34.451330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.466529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0368c-edb2-4eae-8e1e-22e78bb4c806 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.473148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac7928-3ce8-4f9e-a07a-e152d9e1bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.474080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7928-3ce8-4f9e-a07a-e152d9e1bd62 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.474412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7928-3ce8-4f9e-a07a-e152d9e1bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.474758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7928-3ce8-4f9e-a07a-e152d9e1bd62 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.475982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac7928-3ce8-4f9e-a07a-e152d9e1bd62 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.478256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac7928-3ce8-4f9e-a07a-e152d9e1bd62 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.480038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 123/244] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:34.486050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:34.501228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac300a-41b9-4427-af3a-c9833675380f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:34.510349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:34.511072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:34.511360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:34.511641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:34.512496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] RBAC: Adding query filter params (role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8, user.id=051cb93831e34e3c87b2534dee3827b6) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:34.512807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:34.514726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3e991-96d3-4544-bda2-cbefac6bbbf7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:34.524942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 122/245] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:34 2021] GET /identity/v3/role_assignments?user.id=051cb93831e34e3c87b2534dee3827b6&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:35.504163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad1b39-ed6b-4408-b223-7a0479e978c0 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.505111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad1b39-ed6b-4408-b223-7a0479e978c0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.505111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad1b39-ed6b-4408-b223-7a0479e978c0 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.506616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 124/246] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:35.525724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.526664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.526664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.548342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:35.549512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:35.562103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 123/247] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:35.604304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad1b39-ed6b-4408-b223-7a0479e978c0 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:35.620703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad1b39-ed6b-4408-b223-7a0479e978c0 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:35.631118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:35.631938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.632214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.632488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.649669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:35.657436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:35.658668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 125/248] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:35.665460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:35.680692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc51d-6e0e-48f2-8763-e49fcca91b5d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:35.690944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:35.691749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.692011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.692292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.693053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:35.693363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:35.694999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:35.711580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 124/249] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:35.716888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:35.727044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e44ca1-065f-4a0c-b11b-f25345e11464 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:35.739332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:35.740154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.740427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.740706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.755919 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:35.757645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:35.767613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 126/250] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:35.773545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:35.788818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296284-bb54-4a08-af71-85c47d0e02a9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:35.795972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:35.796855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.797138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.797413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.803884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:35.805991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:35.807800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 125/251] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:35 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:35.813536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:35.823137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014d035-cb49-4cbb-9cb1-11258ff7e9c8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:35.830611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:35.831574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.831860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.832219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.839905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:35.841039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:35.841039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:35.841039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:35.842292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89774b4d-74b6-4bef-a8b9-f206764f4f31 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:35.844369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 127/252] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:35 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:35.851198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:35.864548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aa090-9b95-4b06-bce8-eddb99ea6c3d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:35.875248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:35.875923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.876207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.876487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.877334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=58c7199938d943d7a31ec342ea304e39) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:35.877651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:35.880426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e930f0-43ab-4c00-92b2-379b6ad40e7b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:35.891729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 126/253] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:35 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:35.946315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4048f57-13b2-4356-9b7d-e1899853e216 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.946652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4048f57-13b2-4356-9b7d-e1899853e216 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.946867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4048f57-13b2-4356-9b7d-e1899853e216 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:35.949023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 128/254] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:35.964999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:35.965307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:35.965558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.100814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:36.102003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:36.113693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 127/255] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:36.160484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4048f57-13b2-4356-9b7d-e1899853e216 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.175046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4048f57-13b2-4356-9b7d-e1899853e216 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.180129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.180987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.181269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.181546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.195483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:36.202697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:36.203995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 129/256] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:36.210520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.219736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c002fe8-603d-489f-a6ae-12589367fc81 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.228764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.229459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.229746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.230023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.230858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:36.231192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.232925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.247661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 128/257] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.253576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.264160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f045e-296a-44b9-9eeb-1f5266adc082 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.271969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.272626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.272970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.273250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.283672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.285611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.297878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 130/258] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:36.304503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.314176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a096b-fed9-4333-b253-6ee678e0a992 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.321130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.322067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.322353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.322685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.323917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.326115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.327863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 129/259] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.334790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.343840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60fed-2fba-4002-a423-925c27c1c6b2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.351494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b755-9608-4509-a228-d1f1ad30a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.352356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b755-9608-4509-a228-d1f1ad30a949 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.352637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b755-9608-4509-a228-d1f1ad30a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.353010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b755-9608-4509-a228-d1f1ad30a949 admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.355222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b755-9608-4509-a228-d1f1ad30a949 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.357232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b755-9608-4509-a228-d1f1ad30a949 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.359278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 131/260] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.365479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.375335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b9ea3-ab68-42ce-85a6-2a8dfda1ad37 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.384253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.384933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.385220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.385552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.386399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:36.386768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.388949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28abfe-a80f-4fc7-a6e3-797baf8203f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.396408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 130/261] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.574946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a387-31ce-4719-a65c-1483842b1256 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.575663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a387-31ce-4719-a65c-1483842b1256 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.575663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a387-31ce-4719-a65c-1483842b1256 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.577413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 132/262] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:36.598232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.598232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.598232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.619471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:36.620565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:36.630287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 131/263] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:36.656249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a387-31ce-4719-a65c-1483842b1256 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.676549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a387-31ce-4719-a65c-1483842b1256 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.681635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.682535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.682825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.683127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.697464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:36.705034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:36.706405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 133/264] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:36.713086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.722107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545809-fc6e-434d-be63-25fbd8e0a295 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.730793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.731593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.731875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.732156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.732979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:36.733289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.734983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.751019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 132/265] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.756968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.766637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0da1-fe78-4278-95c2-039de5adb37b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.774660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.775452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.775736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.776012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.785426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.787373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.808326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 134/266] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:36.813946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.825963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773303cb-8faa-4205-9f71-103d8a6325be admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.834540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.835554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.835842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.836121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.837339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.839629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.841714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 133/267] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.847289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.856484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a1327-690c-46b8-a716-eb1df5707efa admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.869625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424d853-4b5b-4cc1-b354-933eae150596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.870550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424d853-4b5b-4cc1-b354-933eae150596 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.870879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424d853-4b5b-4cc1-b354-933eae150596 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.871242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424d853-4b5b-4cc1-b354-933eae150596 admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.875702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424d853-4b5b-4cc1-b354-933eae150596 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.877779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424d853-4b5b-4cc1-b354-933eae150596 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.879758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 135/268] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:36.886154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:36.900265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55edab-c4b5-4bab-b735-eddcb6b2800d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:36.911708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:36.912893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:36.913404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:36.914011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:36.915074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:36.915591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:36.917674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb3e84-3228-4959-b9cb-01e3621bc8b1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:36.929751 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 134/269] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:36 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.076758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3e410-6a5c-4d5c-b4ff-ccdf38c8cdee None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.077105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3e410-6a5c-4d5c-b4ff-ccdf38c8cdee None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.077325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3e410-6a5c-4d5c-b4ff-ccdf38c8cdee None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.079352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 136/270] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:37.089507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.090130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.090608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.113251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:37.115001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:37.130357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 135/271] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:37.175074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3e410-6a5c-4d5c-b4ff-ccdf38c8cdee None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.190995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3e410-6a5c-4d5c-b4ff-ccdf38c8cdee None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.196392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.197269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.197549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.197827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.213942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:37.221167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:37.223229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 137/272] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:37.229268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.244638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447f0d-4f79-471f-a2b6-5208e4f18152 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.257073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.257766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.258060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.258339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.259131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:37.259447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.261082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.278011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 136/273] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.283640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.293523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc8840-85e5-41dd-81f6-8f1f82ff9502 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.304330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.305004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.305285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.305563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.319472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.321271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.339513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 138/274] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:37.345200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.360057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f050e4-446e-4b8a-aea9-7dc1b76db15e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.367653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.368532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.368816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.369096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] PATH_INFO: `/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.375880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] RBAC: Authorizing `identity:get_project(project_id=25cc3ad984ea4044b5e9444df5ff7faf)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.377729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.380631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 137/275] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.385952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.397546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf0a3-3c33-4928-9d7d-d20380ad3b02 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.405476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192b71-036f-40d9-b90a-86f299f8c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.406349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192b71-036f-40d9-b90a-86f299f8c28b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.406635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192b71-036f-40d9-b90a-86f299f8c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.406929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192b71-036f-40d9-b90a-86f299f8c28b admin admin] PATH_INFO: `/v3/groups/9a4327a808994f44994639d437ef1b23` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.423822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192b71-036f-40d9-b90a-86f299f8c28b admin admin] RBAC: Authorizing `identity:get_group(group_id=9a4327a808994f44994639d437ef1b23)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.426379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192b71-036f-40d9-b90a-86f299f8c28b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.428149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 139/276] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/groups/9a4327a808994f44994639d437ef1b23 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.434067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.448021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b38e-585a-484c-83f1-80d3512acc6a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.455928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.456600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.456998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.457788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.458639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] RBAC: Adding query filter params (group.id=9a4327a808994f44994639d437ef1b23, role.id=620fb448cda4468da4c7442522368bea, scope.project.id=25cc3ad984ea4044b5e9444df5ff7faf) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:37.458978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.460880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7f20a-e354-4126-8ba5-19baa58d5150 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.471660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 138/277] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/role_assignments?group.id=9a4327a808994f44994639d437ef1b23&scope.project.id=25cc3ad984ea4044b5e9444df5ff7faf&role.id=620fb448cda4468da4c7442522368bea => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.777966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdb48-c88f-4927-9305-f12fb73034b9 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.778651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdb48-c88f-4927-9305-f12fb73034b9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.778651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdb48-c88f-4927-9305-f12fb73034b9 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.780493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 140/278] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:37.786651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.787333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.787333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.812036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:37.813233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:37.821651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 139/279] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:37.845655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcdb48-c88f-4927-9305-f12fb73034b9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.862399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcdb48-c88f-4927-9305-f12fb73034b9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.867382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.868181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.868467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.868744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.884873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:37.892092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:37.893595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 141/280] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:37.900742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.912623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb065b5-811c-4d96-8d0b-09cfc4efa8e6 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.923058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.923755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.924041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.924319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.925089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:37.925397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.927298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.943733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 140/281] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.950037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.964181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f537f4-20c3-46f9-b325-cb617e37ffcd admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:37.968498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:37.969377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:37.969660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:37.969934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:37.976214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:37.978208 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:37.980192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 142/282] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:37.986118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:37.999823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d43979-3d64-4d90-891f-0f9a4b2a32b1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:38.007397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737181-919b-470e-a507-f5b9352abdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:38.008277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737181-919b-470e-a507-f5b9352abdcf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:38.008569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737181-919b-470e-a507-f5b9352abdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:38.008847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737181-919b-470e-a507-f5b9352abdcf admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:38.016287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737181-919b-470e-a507-f5b9352abdcf admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:38.017830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737181-919b-470e-a507-f5b9352abdcf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:38.020466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 141/283] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:37 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:38.026109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:38.036237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8011-8966-4fe0-8d53-89725e880d42 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:38.046610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710ce6a-4256-4981-8b9b-4984c199561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:38.047540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ce6a-4256-4981-8b9b-4984c199561a admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:38.047822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ce6a-4256-4981-8b9b-4984c199561a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:38.048097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ce6a-4256-4981-8b9b-4984c199561a admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39/groups/cc70651271134f9e81f23c50e2507bb3/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:38.050025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710ce6a-4256-4981-8b9b-4984c199561a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7199938d943d7a31ec342ea304e39, group_id=cc70651271134f9e81f23c50e2507bb3, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:38.052954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710ce6a-4256-4981-8b9b-4984c199561a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:38.074286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 143/284] 10.222.0.66 () {58 vars in 1464 bytes} [Tue Jul 13 08:28:38 2021] PUT /identity/v3/projects/58c7199938d943d7a31ec342ea304e39/groups/cc70651271134f9e81f23c50e2507bb3/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:38.729741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae998d7-9bf2-4b44-9140-d027bab02ea5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:38.730114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae998d7-9bf2-4b44-9140-d027bab02ea5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:38.730280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae998d7-9bf2-4b44-9140-d027bab02ea5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:38.732188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 142/285] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:38.738926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:38.739235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:38.739515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:38.761904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:38.763121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:38.847151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 144/286] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:38.892403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae998d7-9bf2-4b44-9140-d027bab02ea5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:38.904852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae998d7-9bf2-4b44-9140-d027bab02ea5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:38.914544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:38.915424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:38.915710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:38.915989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:38.928289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:38.937910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:38.939191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 143/287] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:38.945797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:38.954600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524b2c-fca5-446d-b67c-874f7e3acccc None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:38.959700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:38.960388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:38.960671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:38.960946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:38.961710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:38.962021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:38.963693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:38.977545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 145/288] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:38.983622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:38.994172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae39c2-bcc2-4d7c-a631-c56944e34a2a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.000133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.001011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.001296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.001574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.002741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.005424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.007085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 144/289] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:38 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:39.012759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.023372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4a00-7ec9-478d-aaa2-f80a405bae9c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.027926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe732-a87e-4eb0-9eff-981127cd8c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.028835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe732-a87e-4eb0-9eff-981127cd8c50 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.029121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe732-a87e-4eb0-9eff-981127cd8c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.029400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe732-a87e-4eb0-9eff-981127cd8c50 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.032419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebe732-a87e-4eb0-9eff-981127cd8c50 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.034606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebe732-a87e-4eb0-9eff-981127cd8c50 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.036571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 146/290] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:39 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:39.042507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.052917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337c7a7-73bf-4265-aa01-17dbfd759b1c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.057317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff87ad-3c4f-4d63-aedb-986d5fe7dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.058214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff87ad-3c4f-4d63-aedb-986d5fe7dfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.058501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff87ad-3c4f-4d63-aedb-986d5fe7dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.058779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff87ad-3c4f-4d63-aedb-986d5fe7dfd8 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39/groups/cc70651271134f9e81f23c50e2507bb3/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.060970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff87ad-3c4f-4d63-aedb-986d5fe7dfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7199938d943d7a31ec342ea304e39, group_id=cc70651271134f9e81f23c50e2507bb3, role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.063683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff87ad-3c4f-4d63-aedb-986d5fe7dfd8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.087444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 145/291] 10.222.0.66 () {58 vars in 1464 bytes} [Tue Jul 13 08:28:39 2021] PUT /identity/v3/projects/58c7199938d943d7a31ec342ea304e39/groups/cc70651271134f9e81f23c50e2507bb3/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:39.403201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b036d9-1dc8-4604-b73a-283104f6286f None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.403599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b036d9-1dc8-4604-b73a-283104f6286f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.403805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b036d9-1dc8-4604-b73a-283104f6286f None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.405742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 147/292] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:39.411685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.411975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.412303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.442938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:39.444135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:39.512765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 146/293] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:39.537010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b036d9-1dc8-4604-b73a-283104f6286f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.549021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b036d9-1dc8-4604-b73a-283104f6286f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.553292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.554098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.554381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.554651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.566088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:39.573707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:39.575318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 148/294] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:39.581323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.590287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743845d-f164-4ce3-843e-68e7afc8ea66 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.594631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.595349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.595637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.595916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.596745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:39.597063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.599333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.608820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 147/295] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:39.614725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.624882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2413a-7b77-4adf-acd2-c241bd6ec5f6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.629719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.630679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.630991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.631275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.632479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.634424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.636341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 149/296] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:39 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:39.641899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.652305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99915d-171c-478f-90e4-7e31b13a8765 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.656599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e22d9c-1fd5-41a4-856b-9493f21d2b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.657472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e22d9c-1fd5-41a4-856b-9493f21d2b7c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.657756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e22d9c-1fd5-41a4-856b-9493f21d2b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.658030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e22d9c-1fd5-41a4-856b-9493f21d2b7c admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.659227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e22d9c-1fd5-41a4-856b-9493f21d2b7c admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.661948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e22d9c-1fd5-41a4-856b-9493f21d2b7c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.663985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 148/297] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:39 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:39.669771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:39.679957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad792a2-8180-4576-87a8-207455dfd68a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:39.684495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9de1-6eda-4ab1-8416-56736743927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:39.685392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9de1-6eda-4ab1-8416-56736743927e admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.685674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9de1-6eda-4ab1-8416-56736743927e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.685954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9de1-6eda-4ab1-8416-56736743927e admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/groups/cc70651271134f9e81f23c50e2507bb3/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.687867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b9de1-6eda-4ab1-8416-56736743927e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a742d49a1a0413086992eb4fb7cd3d8, group_id=cc70651271134f9e81f23c50e2507bb3, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:39.690581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b9de1-6eda-4ab1-8416-56736743927e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:39.710377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 150/298] 10.222.0.66 () {58 vars in 1464 bytes} [Tue Jul 13 08:28:39 2021] PUT /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/groups/cc70651271134f9e81f23c50e2507bb3/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:39.937132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847d34-2f8f-4d12-9ede-60775a4f09b6 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.937829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847d34-2f8f-4d12-9ede-60775a4f09b6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.937829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847d34-2f8f-4d12-9ede-60775a4f09b6 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.939807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 149/299] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:39.945989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:39.946622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:39.946622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:39.965480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:39.966676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:40.039777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 151/300] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:40.073816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847d34-2f8f-4d12-9ede-60775a4f09b6 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.086882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847d34-2f8f-4d12-9ede-60775a4f09b6 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.094608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.095553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.095840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.096173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.109919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:40.117822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:40.119309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 150/301] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:40.126024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.135965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db16de-fd3f-4c3b-9728-911af2e5eb48 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.140793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.141495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.141782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.142064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.142832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:40.143167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.145351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4c09-8ec1-457f-a14e-ff7f2601cb96 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.157557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 152/302] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:40.163958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.177062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde867-e97e-4706-abe9-9c0717d8583f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.177259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2f4ad-5879-422a-a4c7-0e88d3f8339d None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.177259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2f4ad-5879-422a-a4c7-0e88d3f8339d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.177259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2f4ad-5879-422a-a4c7-0e88d3f8339d None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.179645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 153/303] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:40.182130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.183036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.183316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.183584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.185581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.189633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.189765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.189858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 151/304] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:40.189940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.190953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.196348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.207070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382b288-ff2c-4bcd-b519-d80897122e6d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.216535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.217877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:40.219144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.220746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:40.220879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.221154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.226943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.226943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.228173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 152/305] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:40.234299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.244150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 154/306] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:40.251057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257042-db6a-48a1-8a2d-85da7c5e9d8c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.257179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.258356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.258865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.259392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/groups/cc70651271134f9e81f23c50e2507bb3/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.261799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a742d49a1a0413086992eb4fb7cd3d8, group_id=cc70651271134f9e81f23c50e2507bb3, role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.264783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.280675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 153/307] 10.222.0.66 () {58 vars in 1464 bytes} [Tue Jul 13 08:28:40 2021] PUT /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8/groups/cc70651271134f9e81f23c50e2507bb3/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:28:40.295688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.320376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1866b-fd78-451a-8427-0466235ab946 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.435462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.436682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.437179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.437654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.457831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:40.465397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:40.471666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 155/308] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:40.478185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.489172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af3459-9f50-4c9f-a1c4-15606862a7c1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.497951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.499112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.499603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.500133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.501157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:40.501698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.503678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.517087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 154/309] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:40.523760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.533762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fdd68-704f-40a2-89b3-d7ee49b6a502 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.542005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.543300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.543791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.544321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] PATH_INFO: `/v3/groups/9a4327a808994f44994639d437ef1b23` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.546793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a4327a808994f44994639d437ef1b23)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.549132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.552041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 156/310] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/groups/9a4327a808994f44994639d437ef1b23 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:40.557972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.568184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4bf1-ad72-48fc-a1f1-88ee9b06006b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.579347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bcdd2-f904-41ad-9591-af0cda76213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.580722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcdd2-f904-41ad-9591-af0cda76213f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.581261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcdd2-f904-41ad-9591-af0cda76213f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.582317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bcdd2-f904-41ad-9591-af0cda76213f admin admin] PATH_INFO: `/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.584017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bcdd2-f904-41ad-9591-af0cda76213f admin admin] RBAC: Authorizing `identity:get_project(project_id=25cc3ad984ea4044b5e9444df5ff7faf)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.586174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bcdd2-f904-41ad-9591-af0cda76213f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.588178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 155/311] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:40 2021] GET /identity/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:40.594370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:40.605722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973e7a-f911-410d-8a33-f03f58676b56 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:40.614013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df061-9a78-4a5b-af0c-4de38a387aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:40.615495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df061-9a78-4a5b-af0c-4de38a387aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:40.616065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df061-9a78-4a5b-af0c-4de38a387aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:40.616545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df061-9a78-4a5b-af0c-4de38a387aaa admin admin] PATH_INFO: `/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf/groups/9a4327a808994f44994639d437ef1b23/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:40.618860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355df061-9a78-4a5b-af0c-4de38a387aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cc3ad984ea4044b5e9444df5ff7faf, group_id=9a4327a808994f44994639d437ef1b23, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:40.622031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355df061-9a78-4a5b-af0c-4de38a387aaa admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:40.645374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 157/312] 10.222.0.66 () {58 vars in 1464 bytes} [Tue Jul 13 08:28:40 2021] PUT /identity/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf/groups/9a4327a808994f44994639d437ef1b23/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:41.386200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f697-6ab3-4747-9cc2-3c779929f662 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.387222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f697-6ab3-4747-9cc2-3c779929f662 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.387714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f697-6ab3-4747-9cc2-3c779929f662 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.390090 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 156/313] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:41.396563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.397475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.397953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.424002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:41.426170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:41.496819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 158/314] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:41.538431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f697-6ab3-4747-9cc2-3c779929f662 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:41.556670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f697-6ab3-4747-9cc2-3c779929f662 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:41.561553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:41.562700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.563276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.563755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.575572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:41.587390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:41.588988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 157/315] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:41.595158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:41.605112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec7a76-bcd6-418e-b667-7556e6c52749 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:41.614577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:41.615747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.616252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.616769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.617809 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:41.618373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:41.620409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:41.631791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 159/316] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:41.637115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:41.649040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708694f-7323-426f-a797-5fbdda419438 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:41.658189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:41.659241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.659808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.660906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.672583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:41.674715 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:41.685810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 158/317] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:41.692491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:41.705694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae511c-3f50-48b6-91a4-21e807819374 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:41.711515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:41.712828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.713324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.713823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.717205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:41.719696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:41.721770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 160/318] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:41 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:41.728399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:41.737755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb06430-1390-4f0b-8f5d-8175fc505250 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:41.745553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28480e19-5e91-4e9a-928a-f455c0829c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:41.746949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28480e19-5e91-4e9a-928a-f455c0829c5e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.747453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28480e19-5e91-4e9a-928a-f455c0829c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.747967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28480e19-5e91-4e9a-928a-f455c0829c5e admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.749436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28480e19-5e91-4e9a-928a-f455c0829c5e admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:41.751773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28480e19-5e91-4e9a-928a-f455c0829c5e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:41.753689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 159/319] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:41 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:41.759774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:41.770172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d846-874d-47d1-9551-212098288f58 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:41.780666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:41.781715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:41.782271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:41.782760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:41.783976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=58c7199938d943d7a31ec342ea304e39) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:41.784541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:41.787417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380b91-9559-4a12-90aa-ca7324ff7744 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:41.798980 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 161/320] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:41 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:42.096738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708c2ff-99f5-4996-8a88-76e8fa4d6905 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.097532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708c2ff-99f5-4996-8a88-76e8fa4d6905 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.098061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708c2ff-99f5-4996-8a88-76e8fa4d6905 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.100497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 160/321] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:42.106762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.107398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.107888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.128688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:42.130359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:42.138326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 162/322] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:42.164153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708c2ff-99f5-4996-8a88-76e8fa4d6905 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.177419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708c2ff-99f5-4996-8a88-76e8fa4d6905 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.182187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.183407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.183994 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.184520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.197723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:42.205737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:42.209513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 161/323] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:42.216174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.225690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d14f6-3cfa-40bf-9ab7-0941d195fc89 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.230624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.231714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.232213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.232701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.233683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:42.234274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:42.236219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:42.247999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 163/324] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:42.254936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.265457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce40b-7879-4de6-aecd-f0071fa988c1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.271832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.272986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.273544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.274094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.286575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:42.288897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:42.299308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 162/325] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:42.308059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.318455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd50d-31d0-4b10-b80c-19faebaa35a6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.323257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.324509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.325067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.325550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.329869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:42.333048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:42.335332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 164/326] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:42.341289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.353200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff658ad-4e6c-46b4-a748-b0d21907f0ae admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.360793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c920f-c37a-4190-9a9a-8279735a0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.362002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c920f-c37a-4190-9a9a-8279735a0266 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.362545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c920f-c37a-4190-9a9a-8279735a0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.363293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c920f-c37a-4190-9a9a-8279735a0266 admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.366056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c920f-c37a-4190-9a9a-8279735a0266 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:42.371649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c920f-c37a-4190-9a9a-8279735a0266 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:42.374959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 163/327] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:42.383091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.395918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27fb39-f8c2-4e90-8df9-d1fb7c38ad22 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.405929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.406666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.406873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.407176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.408022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=58c7199938d943d7a31ec342ea304e39) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:42.408332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:42.410544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5f851-2412-441d-9a80-35c00050ce69 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:42.423655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 165/328] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=58c7199938d943d7a31ec342ea304e39&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 611 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:42.798547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94764f3-ed3f-4b51-b13e-ed1739292aeb None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.798547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94764f3-ed3f-4b51-b13e-ed1739292aeb None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.799095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94764f3-ed3f-4b51-b13e-ed1739292aeb None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.801620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 164/329] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:42.808124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.808390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.808671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.837331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:42.838846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:42.852478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 166/330] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:42.878605 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94764f3-ed3f-4b51-b13e-ed1739292aeb None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.892510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94764f3-ed3f-4b51-b13e-ed1739292aeb None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.904101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.905076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.905357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.905697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.921544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:42.929574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 08:28:42.931259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 165/331] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:42.939945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.950491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef79dc-8585-4e0e-b646-170f5e8f421e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.955778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:42.956632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:42.957310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:42.957655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:42.958525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:42.958837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:42.960648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:42.970637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 167/332] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:42.978703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:42.989659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbc5f-be4b-4f6b-9777-89cea515c6b6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:42.998241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.000046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.000046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.000342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.017893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.021433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.042332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 166/333] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:43.050864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.070740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05d264-611e-430a-aa4d-037535cfebc5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.078352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.079637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.080152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.080643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.083902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.087529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.089671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 168/334] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.095799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.106606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4bd1e-8aa1-42d1-8221-2f77d306fe22 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.116609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea3632-677d-4faa-830f-d657173f876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.118805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea3632-677d-4faa-830f-d657173f876f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.119515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea3632-677d-4faa-830f-d657173f876f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.119878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea3632-677d-4faa-830f-d657173f876f admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.123582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea3632-677d-4faa-830f-d657173f876f admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.127565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea3632-677d-4faa-830f-d657173f876f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.131308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 167/335] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.140894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.155221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3062b0-e431-4edd-8592-9da8a2b07749 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.165177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.166885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.167770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.168525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.170282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=203bf99a9ac2403da939ebc0cc300d68, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:43.171247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.174871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd4986-d476-4443-a529-1f9fb5b1ad6d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.185700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 169/336] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=203bf99a9ac2403da939ebc0cc300d68 => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.456366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827b4c3-79a4-4f1c-b812-d7ba230afaa2 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.457369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827b4c3-79a4-4f1c-b812-d7ba230afaa2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.457563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827b4c3-79a4-4f1c-b812-d7ba230afaa2 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.460677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 168/337] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:43.466251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.466836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.466836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.486322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:43.488434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:43.499977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 170/338] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:43.525416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827b4c3-79a4-4f1c-b812-d7ba230afaa2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.540476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827b4c3-79a4-4f1c-b812-d7ba230afaa2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.547074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.548267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.548688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.548966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.563057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:43.570410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:43.572020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 169/339] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:43.578986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.588314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db401-08a9-4569-ab65-ce909d9b62fe None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.596345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.597029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.598282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.598633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.599395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:43.599778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.601436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.613681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 171/340] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:43.621019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.632444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb58f2-6127-4b51-afdc-de0a959adab8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.637558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc7ed-db14-4594-bd1e-ac143a52ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.638373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc7ed-db14-4594-bd1e-ac143a52ed81 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.638807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc7ed-db14-4594-bd1e-ac143a52ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.639247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc7ed-db14-4594-bd1e-ac143a52ed81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.649154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc7ed-db14-4594-bd1e-ac143a52ed81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.651007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc7ed-db14-4594-bd1e-ac143a52ed81 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.660999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 170/341] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:43.666631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.676976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bfc1-0c5f-4fdf-ba96-da42ddd0fda3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.681232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.681381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d6696-bc7e-4c0e-9455-bd32a5b6b345 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.681539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d6696-bc7e-4c0e-9455-bd32a5b6b345 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.681817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d6696-bc7e-4c0e-9455-bd32a5b6b345 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.682170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.682461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.682739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.683611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 171/342] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:43.684040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.686109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.687873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 172/343] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.688750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.689044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.689318 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.694210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.703404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148035f8-40f5-458b-af67-a16213c12ac5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.713386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.713586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:43.713825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.713825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.713825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] PATH_INFO: `/v3/groups/cc70651271134f9e81f23c50e2507bb3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.714069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:43.714151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc70651271134f9e81f23c50e2507bb3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.714151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.714151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 173/344] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/groups/cc70651271134f9e81f23c50e2507bb3 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:43.719278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.722950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 172/345] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:43.728790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8932d-ef94-4d70-8b77-fe6834c21d08 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.733428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.734072 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.734345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.734614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.735481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] RBAC: Adding query filter params (group.id=cc70651271134f9e81f23c50e2507bb3, role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:43.735998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.737631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.744650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.744842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 174/346] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/role_assignments?group.id=cc70651271134f9e81f23c50e2507bb3&scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:43.754225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe004b7-8131-458a-9733-3737f3cdfe60 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.759151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.759969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.760254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.760529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.773526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:43.780541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:28:43.781817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 173/347] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:43.788253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.798117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee656557-2874-44e2-ad9c-4833eca24698 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.803285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.803971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.804251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.804529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.805340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:43.805689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.807492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.817830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 175/348] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.823851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.833762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953720d-4c7a-406c-9b1e-16e95baaa551 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.839050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.839722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.840005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.840280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.850105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.851938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.861449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 174/349] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:43.868442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.880787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282db94-9501-43f5-b23f-a77ab52759b0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.885246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.886123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.886403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.886678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] PATH_INFO: `/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.887982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] RBAC: Authorizing `identity:get_project(project_id=25cc3ad984ea4044b5e9444df5ff7faf)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.889850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.891681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 176/350] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.898981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.907763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a096aa-6536-4259-9f74-11df535791c2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.912878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef98f-eceb-4447-a6f3-4a6f15458e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.913727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef98f-eceb-4447-a6f3-4a6f15458e15 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.914004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef98f-eceb-4447-a6f3-4a6f15458e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.914291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef98f-eceb-4447-a6f3-4a6f15458e15 admin admin] PATH_INFO: `/v3/groups/9a4327a808994f44994639d437ef1b23` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.915493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ef98f-eceb-4447-a6f3-4a6f15458e15 admin admin] RBAC: Authorizing `identity:get_group(group_id=9a4327a808994f44994639d437ef1b23)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.917415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ef98f-eceb-4447-a6f3-4a6f15458e15 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.919885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 175/351] 10.222.0.66 () {56 vars in 1202 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/groups/9a4327a808994f44994639d437ef1b23 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:43.926819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:43.937277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8bc5-d3a3-4dae-9415-4c4074f1af59 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:43.942113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:43.942774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:43.943144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:43.943421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:43.944260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] RBAC: Adding query filter params (group.id=9a4327a808994f44994639d437ef1b23, role.id=620fb448cda4468da4c7442522368bea, scope.project.id=25cc3ad984ea4044b5e9444df5ff7faf) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:43.944967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:43.946430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acf3c5-ec9a-465f-b32f-6549de9bb169 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:43.953032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 177/352] 10.222.0.66 () {56 vars in 1398 bytes} [Tue Jul 13 08:28:43 2021] GET /identity/v3/role_assignments?group.id=9a4327a808994f44994639d437ef1b23&scope.project.id=25cc3ad984ea4044b5e9444df5ff7faf&role.id=620fb448cda4468da4c7442522368bea => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:46.615609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a825b-0ca9-42d2-85ef-4da64e6cccf1 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:46.616164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a825b-0ca9-42d2-85ef-4da64e6cccf1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:46.616164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a825b-0ca9-42d2-85ef-4da64e6cccf1 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:46.618281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 176/353] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:46.624263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:46.625179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:46.625686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:46.652453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:46.653975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:46.666815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 178/354] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:46.716516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a825b-0ca9-42d2-85ef-4da64e6cccf1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:46.733470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a825b-0ca9-42d2-85ef-4da64e6cccf1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:46.742792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:46.743634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:46.743918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:46.744188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:46.756453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:46.758349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:46.786444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:46.788104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 177/355] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:46.794454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:46.808655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1341d-5901-4e0a-8bce-cf54e3d18131 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:46.827902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:46.828953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:46.829439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:46.829912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:46.830890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:46.831472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:46.833407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdbe59-2eed-4ff9-98b9-89024f3695e5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:46.861475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 179/356] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:46.868707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:46.884371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02faf9-13e6-4eee-8e81-3703c5badb71 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:46.892643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b1e8c-a765-43e9-a105-e8af0805f3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:46.893339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1e8c-a765-43e9-a105-e8af0805f3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:46.893622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1e8c-a765-43e9-a105-e8af0805f3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:46.893991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1e8c-a765-43e9-a105-e8af0805f3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:46.894953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b1e8c-a765-43e9-a105-e8af0805f3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:46.896934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b1e8c-a765-43e9-a105-e8af0805f3e9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:46.929900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 178/357] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:46 2021] POST /identity/v3/users => generated 246 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:47.080216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0ea6-ffe2-4bf9-83e6-fe7e90a1143f None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.080865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0ea6-ffe2-4bf9-83e6-fe7e90a1143f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.081374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0ea6-ffe2-4bf9-83e6-fe7e90a1143f None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.084331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 180/358] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:47.090409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.090698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.090989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.110958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:47.112135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:47.127410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 179/359] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:47.170292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada0ea6-ffe2-4bf9-83e6-fe7e90a1143f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:47.190269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada0ea6-ffe2-4bf9-83e6-fe7e90a1143f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:47.199222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:47.200404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.200916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.201387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.219828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:47.222256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:47.242968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:47.245029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 181/360] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:47.252065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:47.265918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb9b2-c193-4745-9287-8132f9dc67eb None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:47.275640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:47.276327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.276612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.276893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.277640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:47.277940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:47.278993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:47.278993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:47.278993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:47.279910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2791dac-4ea8-4ac9-8e10-63b8dc991832 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:47.299749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 180/361] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:47.306154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:47.313465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10f9e-3109-4271-965e-b82111aa9365 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.314020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10f9e-3109-4271-965e-b82111aa9365 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.314453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10f9e-3109-4271-965e-b82111aa9365 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.317514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 181/362] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:47.319679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03252c-a3e9-4978-8052-f05b5542f94c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:47.325510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:47.326075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.326404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.326714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.326824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.327335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.327448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.328739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:47.331161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:47.348631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:47.350096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:47.359260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 182/364] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:47 2021] POST /identity/v3/users => generated 248 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:47.359544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 182/364] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:47.386023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:47.397802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6afb24-a1f9-4265-9205-94dad1d07d41 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:47.402822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:47.404531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.405363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.406015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.421361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:47.423921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:47.444638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:47.446667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 183/365] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:47.452506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:47.463723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee65e3-ef47-4d89-9924-df99ecdb2632 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:47.469140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:47.469878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.470163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.470480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.471288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:47.471597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:47.474028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72fdf-b251-4a76-9e10-d231a32fafee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:47.489757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 183/366] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:47.495238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:47.504944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58cebc-5195-4a60-921d-0ba239d0273b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:47.509598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d478fc-c690-47b0-98ad-db2089206288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:47.510418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d478fc-c690-47b0-98ad-db2089206288 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:47.510772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d478fc-c690-47b0-98ad-db2089206288 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:47.511147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d478fc-c690-47b0-98ad-db2089206288 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:47.511975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d478fc-c690-47b0-98ad-db2089206288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:47.514016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d478fc-c690-47b0-98ad-db2089206288 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:47.538708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 184/367] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:47 2021] POST /identity/v3/users => generated 248 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:48.007243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf46c0-b01a-4e11-9421-44ab5551395c None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.007802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf46c0-b01a-4e11-9421-44ab5551395c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.008388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf46c0-b01a-4e11-9421-44ab5551395c None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.011878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 184/368] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:48.021923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.022436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.022742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.059989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:48.061171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:48.071650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 185/369] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:48.097306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf46c0-b01a-4e11-9421-44ab5551395c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:48.109468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf46c0-b01a-4e11-9421-44ab5551395c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:48.114377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:48.115253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.115531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.115800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.127872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:48.130506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:48.148166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:48.149732 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 185/370] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:48.155812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:48.164730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fd0e-7b6c-4d69-ba0f-839ebabea71a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:48.169132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:48.169796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.170073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.170358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.171104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:48.171466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:48.173182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8b739-1b3e-417d-86ff-c7adb0ffb75e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:48.186753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 186/371] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:48.192441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:48.202046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387308-748a-4adf-90bc-8f88644c4d7c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:48.207021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde09f-efae-479c-89e6-1df59405cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:48.207864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde09f-efae-479c-89e6-1df59405cf4f admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.208202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde09f-efae-479c-89e6-1df59405cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.208518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde09f-efae-479c-89e6-1df59405cf4f admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.209249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde09f-efae-479c-89e6-1df59405cf4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:48.211203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde09f-efae-479c-89e6-1df59405cf4f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:48.233461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 186/372] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:48 2021] POST /identity/v3/users => generated 249 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:28:48.621317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563935-8fa2-4e68-b028-740a9f43d432 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.621717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563935-8fa2-4e68-b028-740a9f43d432 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.621891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563935-8fa2-4e68-b028-740a9f43d432 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.624160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 187/373] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:48.630944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.631274 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.631548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.651955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:48.653170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:48.661652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 187/374] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:48.686276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80563935-8fa2-4e68-b028-740a9f43d432 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:48.702628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80563935-8fa2-4e68-b028-740a9f43d432 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:48.709303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:48.710422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.710995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.711473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.712643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:48.714492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:48.724783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.sql.core [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 08:28:48.724783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 08:28:48.724783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [parameters: {'id': '0a46a2827c204961bf745fb8b27b375b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 08:28:48.724783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: (Background on this error at: http://sqlalche.me/e/14/gkpj) {{(pid=72637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:531}} Jul 13 08:28:48.746528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 08:28:48.748655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 188/375] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:28:48 2021] POST /identity/v3/roles => generated 144 bytes in 63 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:48.755057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:48.764323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9338-5143-4e9f-a90f-25c763681bed None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:48.770101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875a947-a0aa-461f-b698-714288e30d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:48.771031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875a947-a0aa-461f-b698-714288e30d34 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.771362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875a947-a0aa-461f-b698-714288e30d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.771637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875a947-a0aa-461f-b698-714288e30d34 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.783705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875a947-a0aa-461f-b698-714288e30d34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:48.791282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3875a947-a0aa-461f-b698-714288e30d34 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 08:28:48.792923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 188/376] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:28:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:48.801749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:48.812833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9cd35-51e8-4619-bdb8-b8f32ff5c6f7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:48.818372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:48.819168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:48.819449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:48.819767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:48.820532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:48.820883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:48.822727 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8a8b-14c9-4108-9bea-66205e198d56 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:48.833539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 189/377] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.061374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8df3e-5a36-4822-8e38-ce542aaff075 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.061896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8df3e-5a36-4822-8e38-ce542aaff075 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.061896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8df3e-5a36-4822-8e38-ce542aaff075 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.064030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 189/378] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:50.076706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.077215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.077290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.101978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:50.103206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:50.113903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 190/379] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:50.159174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8df3e-5a36-4822-8e38-ce542aaff075 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.176716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8df3e-5a36-4822-8e38-ce542aaff075 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.181134 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.181936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.182221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.182500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.201442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:50.209070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:50.210355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 190/380] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:50.216285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.225677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e759e-7d23-4285-84f1-e51af8baba3b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.238547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.238547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.238547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.238547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.238969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.238969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.240164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3d0a2-2c41-4845-b320-52ad1180e650 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.255000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 191/381] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.258636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.270247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c2ca-4c79-4ff6-8fad-a2d0973a0e2e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.272247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db702d63-f6ea-4049-bb75-7dd866ad415e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.272534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db702d63-f6ea-4049-bb75-7dd866ad415e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.273127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db702d63-f6ea-4049-bb75-7dd866ad415e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.274937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 192/382] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:50.280874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.281153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.281430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.290289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.291112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.291392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.291667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.310296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:50.311554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:50.314939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.317988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.330680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 193/383] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:50.346773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:50.356394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.367309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200cfab-e434-4b1c-a19e-5d415ba2786b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.368256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 191/384] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.383531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.384702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.385237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.385786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.386776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.387357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.389305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.390826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.407754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebdcc6-5e17-40d3-adb1-4cd08ed95008 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.410394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 194/385] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.416674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.421427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d977ee5-9f76-4436-84a9-7e809b8254f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.422800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d977ee5-9f76-4436-84a9-7e809b8254f5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.423364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d977ee5-9f76-4436-84a9-7e809b8254f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.423878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d977ee5-9f76-4436-84a9-7e809b8254f5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.427806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b91c6-2fc1-4eba-a9cf-dd1337832be3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.432753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.433821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.434297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.434727 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.445513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d977ee5-9f76-4436-84a9-7e809b8254f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:50.445983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.448309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.460494 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4d977ee5-9f76-4436-84a9-7e809b8254f5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:50.463229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 192/386] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.469086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:28:50.469242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055b2d-0e90-4447-839c-8c04a4c4aa07 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.469242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055b2d-0e90-4447-839c-8c04a4c4aa07 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.469242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055b2d-0e90-4447-839c-8c04a4c4aa07 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.470071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 193/387] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:50.471559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 195/388] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.475375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055b2d-0e90-4447-839c-8c04a4c4aa07 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.478877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.488963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440231-e1ca-4a07-b366-61a0c8314b2f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.494436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.495662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.496142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.496587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.497683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.498183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.499382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055b2d-0e90-4447-839c-8c04a4c4aa07 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.499802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:50.499802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:50.499802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:50.501423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.506397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.507556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.508065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.508542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.509905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.510458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.513719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71356041-fb0a-4abb-bc9e-e1808eaa57ac admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.530288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 194/389] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.538280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.538280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.538280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.561911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 196/390] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.563944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.568303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:50.569582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:50.575961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8118-71bd-47b9-83c3-47a8bdbc7485 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.577086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 195/391] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:50.580755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.582503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.583226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.583658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.584122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.595630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.599472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.601253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dece1-53b1-44d5-9f04-7193705ded36 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.616394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.617232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.617625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.618024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.628869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.632795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.640623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 196/392] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:50.641733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.651876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cc6a5-832a-45d3-be33-fb55a5269be1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.656951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.657949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.658340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.658746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.672624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:50.680184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:50.681681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 197/393] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.687618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.698684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265b234-9d40-4a6e-9801-9964908d66f3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.703827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.704869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.705256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.705654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.719517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.721884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.743240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:50.745031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 198/394] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.745919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.757300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:50.759222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 197/395] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.760191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.767949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c311c9-62b8-4824-a296-95f69af5180e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.772214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354aa17-bbee-4e0d-bffb-769e582bc861 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.773823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.774616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.775062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.775444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.776305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.776727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.777939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.778581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.778955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.779425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.779855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.781033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.781893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.783793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.789481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 199/396] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.794847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.798882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 198/397] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.800141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.804821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafff68-9977-4ada-9320-6877b2a7fce4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.809201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.809983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.810378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.810761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.811642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.812113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.813372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532ffef-3ec7-4e1e-a6f8-74b554b1ea35 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.814037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.822112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.823177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.823630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.824119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.827636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 200/398] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.828673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.838803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.841863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.843363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4721c4d-1eb4-4008-a7c0-d71be9d7de3d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.848292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.849212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.849607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.849992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.857413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.859595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.865046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:50.867511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 199/399] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.868772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.880320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:50.880846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fa78b-5fbe-403f-ac73-87c837f1f1e6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.881808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 201/400] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.882900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.885920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.887023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.887504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.888208 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.892790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe7679-31c5-4a5a-806c-2fe48546bd66 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.898432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.899269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.899653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.900032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.900834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.900959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.901359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.903070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.903614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.916737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 202/401] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.922158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.923820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:28:50.926777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 200/402] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.927819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.937382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fa159-6727-4957-8950-8475c21f9fc3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.937572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d2c1-2186-4240-b288-16aa30a843e5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.942651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.943517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.943908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.944175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.944379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.945257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.945371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.945737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.945914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.946330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.947138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:50.947138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:50.947138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:50.948481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.955235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.958845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.967972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 203/403] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:50.969041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.977740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:28:50.978215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e276c-ef13-4497-acf9-642340370656 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.979420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 201/404] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:50.980360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:50.988058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.988941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.989332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.989714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:50.990692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:50.991133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:50.992258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:50.992258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:28:50.992258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:28:50.992553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060ec9e-c9ff-4caf-9349-bc3c2df7a059 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:50.993709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:50.997292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:50.998148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:50.998585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:50.999064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.000047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=3b41f9cf1fe54552abe59a56251cfa7b) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.000500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.002591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.013350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 202/405] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/role_assignments?user.id=3b41f9cf1fe54552abe59a56251cfa7b&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.014663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.030411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e0754-7f95-423d-b741-51653a2cc576 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.035679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 204/406] 10.222.0.66 () {56 vars in 1159 bytes} [Tue Jul 13 08:28:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.036925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.037767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.038352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.038762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.039933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.040473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.042328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.043032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.053894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83bb23-b502-4f85-8891-fc00182ee7fc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.059278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.060085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.060516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.060899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.068937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 203/407] 10.222.0.66 () {56 vars in 1159 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.075712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.076486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.081991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.092825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1369709-3949-42a0-a7b3-0b0808271611 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.093364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 205/408] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:51.099622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.106476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2495-c588-44eb-8a56-4f30130ba1bc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.108516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.109314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.109749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.110132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.121557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.122565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.123532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.123919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.126776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.131294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.147702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.152158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.152895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 204/409] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:51.160347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.171295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b5e-e20f-494a-850c-fb452f582f25 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.183500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.184566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.184957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.185380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.195926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:51.197570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 206/410] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:51.205159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.210082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.211991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.214957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387842-ce7b-4d60-a5db-3362fd7fe655 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.223924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.224598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.224876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.225148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.225874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.226175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.227936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.238128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-3bcb4eda-2a7b-47f0-bd20-d8d6e263a7ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:51.239688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 205/411] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:51.247099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d1bf8-a68c-4fd4-838a-5352e904a643 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.247099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d1bf8-a68c-4fd4-838a-5352e904a643 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.247099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d1bf8-a68c-4fd4-838a-5352e904a643 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.247796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 207/412] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.249572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 206/413] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:51 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:51.252037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.253845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d1bf8-a68c-4fd4-838a-5352e904a643 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.264170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81edd-a50d-499b-9709-c3d40e37f1fb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.268530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.269780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.270103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.270335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.271094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.271398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.273137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a41a-4956-4ad8-a00a-7a18166837eb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.274017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d1bf8-a68c-4fd4-838a-5352e904a643 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.279070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.280457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.280738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.281011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.289299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 208/414] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.289594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.290713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.291027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.291307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.291633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.308289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:51.309607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 207/415] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:51.309814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:51.310390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.311024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:51.324122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 209/416] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:51.325646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7356-6f74-4ac2-9ff3-cb5255e1cca0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.327544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.337246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.338167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.338443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.338753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.348305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c975-5c33-48a6-b66c-0264d8323135 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.351729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.353731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.356320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.356982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.357262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.357537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.358330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.358638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.360573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.369691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:51.372035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 208/417] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:51.372822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.378676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 210/418] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.380341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.388821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65468ee-1e8b-449c-88e9-658792442251 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.389521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f989dd-494d-4c16-9af8-7933e1ed77dc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.393412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.395166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.395357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.395551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.395705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.395868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.396126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.396451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.397244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.397555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.399648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.406776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:51.415189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:51.416639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 209/420] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:51.416826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 211/420] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.417428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.423652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.437635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25895070-237c-454f-b370-91b3824cda08 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.438210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dd8c-7207-4901-b2ea-2049d7338ba7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.442944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.443179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.443623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.443810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.443973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.444133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.444292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.444441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.444898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.450932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=679ea61fafe040cdb5235aae7ff59f81) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.451188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.451378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.451533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.451683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.455241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 212/422] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.456081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.463330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 210/422] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/role_assignments?user.id=679ea61fafe040cdb5235aae7ff59f81&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.467367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.480993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d997b-b510-4d7e-8e22-9a56022129ab admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.484055 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba74405-b750-4480-94e7-229d41693e3f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.490498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.491198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.491479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.491754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.492605 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=c2227b93e13c4a418b506b2a2c011c76) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.492918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.494833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.496947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.497756 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.498087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.498358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.512841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 213/423] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/role_assignments?user.id=c2227b93e13c4a418b506b2a2c011c76&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.522295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.524356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.545951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:51.548629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 211/424] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:51.553582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.563140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc60cb-3533-4cdc-b5c9-c922e3f54f4a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.568765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.569499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.569789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.570064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.570822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.571167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.572959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.588217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 214/425] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.594122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.604546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8d85b-1f7b-425b-a2ef-0dc7a7a61285 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.609024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.609901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.610232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.610514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.624489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.626858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.647940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:28:51.650516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 212/426] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:51.655501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.665249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea43db3-547c-4849-b928-aa9dcbe2ea80 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.669719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.670400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.670683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.670995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.671963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.672275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.674153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.694581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 215/427] 10.222.0.66 () {56 vars in 1161 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.700516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.710719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b970a06-c3a4-4b63-a270-b745efb11d1e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.715216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.715873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.716203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.716527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.726266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.728152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.741534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 213/428] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:51.744119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.754969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46145-8183-4e3d-a305-c5d4bb46ab35 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.759726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.760557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.760890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.761217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.777820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.781759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.817310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-a7f09fb2-889f-49f0-b54b-09a6f16ab13e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:51.827083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 216/429] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:51.829506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.846431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f123f-2e69-4a97-89a3-eccfba310db0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.846741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2f128-0cfa-4e3b-83e4-bef7c250561d None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.847316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2f128-0cfa-4e3b-83e4-bef7c250561d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.847822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2f128-0cfa-4e3b-83e4-bef7c250561d None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.851472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 217/430] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:51.858030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.858701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.859006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.859196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.859371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.859635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.860004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.860173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.860343 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.861924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.876552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 214/431] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:51.883046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.892354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143941-1cba-461a-a282-84fe4084c2bb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.893662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:51.895525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:51.898027 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.899077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.899505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.899948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.907719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.910842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.912609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 218/432] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:51.934959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:51.942494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 215/433] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:51.943506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.961241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8c56-4fa2-4acd-9f89-5cd785909347 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.962500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:51.974777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210ee70-35ca-4bc9-8e9b-b67272874937 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:51.975770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.976568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.976963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.977342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.978255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:51.978687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.980616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:51.980829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:51.981812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:51.982239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:51.982670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:51.994479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 219/434] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:51.996056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:51.998189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:52.000347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:52.012267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576df88-9061-417e-8b99-29012a9b5be2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:52.017476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:52.018382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:52.018821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:52.019802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:52.020586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=e987011ba5584a8985871401a7cc5923) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:52.021013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:52.026951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:52.029317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 220/435] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/role_assignments?user.id=e987011ba5584a8985871401a7cc5923&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:52.032626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:52.034477 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 216/436] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:52.042514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:52.065434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482342b7-416f-4a33-8e06-de04ab2093d6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:52.080763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:52.081742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:52.082287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:52.082287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:52.083210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:52.083626 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:52.085334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a073eee-03ab-4f4c-8a97-bfc933b4b9da admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:52.103226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 221/437] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:52.108711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:52.119253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9de5-221f-44f6-be7a-ee8a8d643674 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:52.124069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03baae3-0e65-42af-9084-87a8669e130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:52.124977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03baae3-0e65-42af-9084-87a8669e130f admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:52.125411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03baae3-0e65-42af-9084-87a8669e130f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:52.125817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03baae3-0e65-42af-9084-87a8669e130f admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:52.126672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03baae3-0e65-42af-9084-87a8669e130f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:52.128970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03baae3-0e65-42af-9084-87a8669e130f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:52.152607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 217/438] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:28:52 2021] POST /identity/v3/users => generated 247 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:28:53.654291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e36981-78dd-46e6-90ce-c3d400fe971a None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.655044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e36981-78dd-46e6-90ce-c3d400fe971a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.655044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e36981-78dd-46e6-90ce-c3d400fe971a None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.656651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 222/439] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:53.663268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.663958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.663958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.688043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:53.689391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:53.697617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 218/440] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:53.733654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e36981-78dd-46e6-90ce-c3d400fe971a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:53.748528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e36981-78dd-46e6-90ce-c3d400fe971a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:53.752836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:53.754211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.754211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.755051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.770333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:53.777194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:53.778404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 223/441] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:53.785202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:53.793950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5664-1d08-4921-bccf-8325ce54129e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:53.801424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:53.802102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.802386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.802642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.803434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:53.803743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:53.805372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:53.814266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 219/442] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:53.820097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:53.829268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebecdb-9d46-4279-a043-da35210fc5a6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:53.838805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:53.839619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.839902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.840179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.854699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:53.856610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:53.877063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:53.879466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 224/443] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:53.885253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:53.895774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87636385-8d3f-43e8-8d1c-d5e798d908ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:53.902874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:53.903567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.903855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.904130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.904916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:53.905168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:53.906794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:53.927592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 220/444] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:53.932929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:53.942958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36b81-7421-463e-ad56-9a591c2b43bb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:53.950991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:53.951799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:53.952084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:53.952423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:53.963969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:53.966023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:53.984673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:28:53.986224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 225/445] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:28:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:53.992425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.001998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9f719-f882-4037-89dd-c236773b710d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.011135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.011825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.012110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.012453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.013345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.013664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.015591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.040316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 221/446] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:28:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:54.045743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.057619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88108c5-fef9-4ff9-abf2-60023ff0f93b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.066947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.067688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.068201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.068705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.092920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.095166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.121448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:54.123948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 226/447] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.129318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.141339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c6dce-1ec9-4c74-b951-2764a738d2e3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.152036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.152702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.152987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.153264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.153988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.154294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.155974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.177507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 222/448] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:54.183057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.195753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836935-4f7b-4afe-b7f3-98b56cdedd8b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.207963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.208794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.209075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.209347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.220349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.222879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.246985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-c0b6bca9-69ba-474c-bd15-63b7beca6c06 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:54.253114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 227/449] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.254402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.264477 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d544-bdac-403b-a5ea-80d696fd96fc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.271611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543b08-80f6-41d7-85d6-c86ffe05cf0f None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.271910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543b08-80f6-41d7-85d6-c86ffe05cf0f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.272172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec543b08-80f6-41d7-85d6-c86ffe05cf0f None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.274031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.274570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 228/450] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:54.274760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.275041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.275317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.276153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.276458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.277541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:28:54.277541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:28:54.277541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:28:54.278682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.284513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.284951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.285230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.315133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:54.317307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:54.319972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 223/451] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:54.326023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 229/452] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:54.326455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.340678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db436925-4a77-42b9-a530-533ebb7f7936 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.345424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.346699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.347927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.348416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/3b41f9cf1fe54552abe59a56251cfa7b/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.358250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.369351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d207e-9d80-4cb7-9714-60f01c663a0e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.377270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=3b41f9cf1fe54552abe59a56251cfa7b, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.380969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.383618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe7907-33e9-46bf-8a88-3cdbe7343504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.384415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe7907-33e9-46bf-8a88-3cdbe7343504 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.384700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe7907-33e9-46bf-8a88-3cdbe7343504 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.384978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe7907-33e9-46bf-8a88-3cdbe7343504 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.400192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe7907-33e9-46bf-8a88-3cdbe7343504 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:54.408518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-c2fe7907-33e9-46bf-8a88-3cdbe7343504 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:54.413041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 224/454] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:54 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/3b41f9cf1fe54552abe59a56251cfa7b/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:54.415115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 230/454] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:54.416921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.491998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c587691-01a6-4578-8cd2-3b0647b53c91 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.497000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.497680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.497961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.498234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.499131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.499438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.501436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0c7e-13ea-425b-896d-d199b0a233e3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.504829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fb1a3-daec-4983-9348-344484d61da2 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.505119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fb1a3-daec-4983-9348-344484d61da2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.505402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fb1a3-daec-4983-9348-344484d61da2 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.507304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 231/455] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:54.510895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 225/456] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:54.516655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fb1a3-daec-4983-9348-344484d61da2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.520265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.520597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.520812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.541778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:54.543007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:54.551688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fb1a3-daec-4983-9348-344484d61da2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.552265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 226/457] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:54.568292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.569401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.569842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.570264 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.576229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.585530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287c7a-8cc4-46be-881b-12d3586abf86 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.590154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.595036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.595036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.595036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.604053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.608013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.616095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:54.630306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:54.632882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 227/458] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:54.640990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:54.642231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.643060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 232/459] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.649415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.657167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1944-2d73-40cc-9047-6d49cc29b089 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.664294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab36b-eaed-4a4f-9307-78fab790b993 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.665382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.666047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.666324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.666594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.667381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.667703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.669301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.672107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.673105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.673599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.674132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.676361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.676971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.679165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.683035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 228/460] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:54.685571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.694780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 233/461] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:54.696084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6515e-9235-4363-aa8a-2740c7dc7eb2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.701034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.701341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.702192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.702547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.702796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.714632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eb46f-39b2-48fd-921b-747001b1a42d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.715226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.717266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.720800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.722502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.724162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.724694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.734353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.736825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.738327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:54.744355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 229/462] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:54.745800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.755757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7031c-ca8e-4d1d-831e-d4d04bdba60b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.757717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:28:54.759668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 234/463] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.760926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.761315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.761603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.762195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.762663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.766625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.766625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447aec-f739-44da-b6b4-e7c5f029f6bd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.768593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.779426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 230/464] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:54.783406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ed4d-0631-4741-85ed-87eebc0000d8 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.783739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ed4d-0631-4741-85ed-87eebc0000d8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.784017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ed4d-0631-4741-85ed-87eebc0000d8 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.785148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b227-f593-4dff-b870-1653a617ccce admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.786013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 231/465] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:54.789948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ed4d-0631-4741-85ed-87eebc0000d8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.790658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.791620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.792073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.792489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.793465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.793925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.795828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a348a-0337-4afb-8d81-a0e7ea2d120e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.809418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ed4d-0631-4741-85ed-87eebc0000d8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.814386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.816266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.816697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.817108 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.818214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 235/466] 10.222.0.66 () {56 vars in 1159 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:54.819706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.819951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.820269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.826984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.829995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.838063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:54.839338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:54.845877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:28:54.847048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 236/467] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:54.847764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 232/468] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.856875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.858695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.861794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8d67f-c47e-409e-9381-f1389eb9d95b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.867144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.868056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.868415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.875066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.875202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3451aa-a8a8-48ec-bb52-65d4c1a0ceb6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.889024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.892797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.893767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.895269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.895552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.895825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.896664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.896968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.898821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.922673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 233/469] 10.222.0.66 () {56 vars in 1159 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:54.923521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:54.923648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.925925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 237/470] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.927092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.936390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb7b78-8dd8-4faf-985f-685ade7215a3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.938789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b7212-e513-49eb-a2b3-e4c2e6d40e37 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.940629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.942517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.942950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.943378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.943931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.944866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.945159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.945479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.954843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:54.956709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.958712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.962061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:54.963432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 234/471] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.964389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.973971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c513b01-45ae-4fbc-8f42-a60f8927a27e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.977095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:54.978500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 238/472] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:54.978606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.979226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:54.983714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.984114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.984498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.985342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.985759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.988081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:54.989165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1135a5f-2136-4e42-980f-3950e9473a4b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:54.993629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:54.994336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:54.994620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:54.994969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:54.995824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:54.996137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:54.997840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.002727 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 235/473] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.004432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.012336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 239/474] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.013180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.014295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b48cae-11e1-436b-9b5f-006ab2a4aaed admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.018821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.019772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.020053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.020327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.021049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.021354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.022995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.023190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9604-6189-4ead-be22-b6a7c2e32de0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.027686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.028512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.028801 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.029136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.034657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 236/475] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.037360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.039456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.039934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.049472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425324c2-3586-48c8-8e8d-34b66c96cf56 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.054823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.055355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:55.055630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.055914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.056188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.057251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 240/476] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.062829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.068768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.070715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.072675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7c4d-762e-464c-b7f1-b4f8eb52948f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.077442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.078876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.079202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.079483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.088386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.089293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:55.090410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.090999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 237/477] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.091853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.102482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293ac3-270c-4747-947d-a4869cf303cd admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.106653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:55.107307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.107961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 241/478] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.108768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.113786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.114199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.114492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.115365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.115684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.117708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.120164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3423ed-c18c-4226-a679-e25e36fa3634 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.124965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.126176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.126510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.126793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.128162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.128764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.130509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 238/479] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.130815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e635-fa75-4321-8577-95ca84548840 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.131451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.141134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2c3ea-738a-47d3-bfc7-9a96897fcfd5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.146048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.146698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.147014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.147292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.148067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.148373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.149488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 242/480] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.150387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.150814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596b44-9022-4f35-baae-481d64a08efa None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.151208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596b44-9022-4f35-baae-481d64a08efa None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.151553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596b44-9022-4f35-baae-481d64a08efa None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.155039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 243/481] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:55.155039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86596b44-9022-4f35-baae-481d64a08efa None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.163655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 239/482] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.164586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.170142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86596b44-9022-4f35-baae-481d64a08efa None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.173230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb7fbb-f8e1-42cd-88ea-b0e0b979bff7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.174380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.175945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.176258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.176528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/679ea61fafe040cdb5235aae7ff59f81/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.178450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.179358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.179764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.180142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.188124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.190224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.191461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=679ea61fafe040cdb5235aae7ff59f81, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.194219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.203786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-45226db9-281f-4b56-8e6c-1c8178f13073 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:28:55.205174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 240/483] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/users/neutron => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.206349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.206634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.215499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 244/484] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:55 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/679ea61fafe040cdb5235aae7ff59f81/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:55.215690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.215768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.233823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:55.235136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:55.312254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 241/485] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:55.313278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.315952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b80d8-016f-4110-9dcb-931fd909b32e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.328875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.329827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.331034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.331427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/c2227b93e13c4a418b506b2a2c011c76/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.333931 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112cd17-715a-440f-9d50-7195b5797150 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.343575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.344610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.345127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.345633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.348860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.349503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.352281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.354736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=c2227b93e13c4a418b506b2a2c011c76, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.357691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.377051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 242/486] 10.222.0.66 () {56 vars in 1161 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.378985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.380446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 245/487] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:55 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/c2227b93e13c4a418b506b2a2c011c76/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:55.387026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.397549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8ce0e-591e-4410-8107-7b4f03ef6702 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.466013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.466978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.467258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd40ed-4751-4671-a9a1-f012668d2d85 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.467436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.467898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.472598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.473408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.473924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.474342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.480463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:55.486516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.488808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:55.489175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.490491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 243/488] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.496779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.507200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447608-2887-4d60-acec-6ab86b3ff524 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.510534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:55.512015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.512379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 246/489] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.513256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.513743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.514128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.519225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.519225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.519225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.521373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.533167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 244/490] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.534938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.539997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aef6b-f51d-41dc-8aff-6c1512a95eca admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.546559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94023518-876f-4d03-9e09-7fc1e173e684 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.549154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.551062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.551667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.552095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.552741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.553239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.553802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.553914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.554267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.554847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.556507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.579348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.581478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.587945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 247/491] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.592663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.611014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065b0e-6242-415a-8c26-e25be98252eb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.618234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:55.620957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 245/492] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.622518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.623375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.623691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.623934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.626007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.636172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.637513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344e161-6321-49fe-94c8-d924e6d5c77e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.638418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.642033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.642814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.643129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.643410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.644715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.645004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.647349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.658961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:55.662003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 248/494] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.666955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 246/494] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:55.667848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.671063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.681669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bde1eb-955f-4e95-8ff0-aa25c3610048 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.684879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f675a-3b57-4ed0-a9ed-c42a5942362b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.691632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.692311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.692597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.692872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.693674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.693987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.696442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.698452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.699722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.700333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.700995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.711215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.713991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.714614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 249/495] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:55.722277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.734277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:28:55.735819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 247/496] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:55.743074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dfa2f-0ac5-4978-aa40-bc24709d3b23 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.746165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.748784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.750092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.750526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.751017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/e987011ba5584a8985871401a7cc5923/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.759808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff89d0-5895-4bc0-a291-88ef283fe37a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.762424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.763154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.763416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.763692 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.764545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:55.764850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.766754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.785492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=e987011ba5584a8985871401a7cc5923, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.788345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.789571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 248/497] 10.222.0.66 () {56 vars in 1157 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:55.798237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.810683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02da82-d38d-4956-926e-1464a59a91a3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:55.816127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 250/498] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:55 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/e987011ba5584a8985871401a7cc5923/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:28:55.925736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:55.926826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:55.927398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:55.927883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:55.941385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:55.944891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:55.961185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 249/499] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:55.966784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:55.988298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481d925-f690-45cc-bab4-2107bfb6edbd admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:56.004484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:56.005578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:56.006013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:56.006436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:56.021951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:56.024107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:56.047727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:56.054121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 251/500] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:56.056379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:56.082114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb2cd-cdd6-4afb-9940-e6f2d57771ce admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:56.094735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:56.095913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:56.096402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:56.097436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:56.098818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:56.099387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:56.102612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:56.135197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 250/501] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:56.141091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:56.155054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ed4fb-2784-4dba-9603-de716d8768fa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:56.161051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:56.162096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:56.162528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:56.163033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:56.170690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:56.172908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:56.188416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:56.195302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 252/502] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:56.197990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:56.209715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bb02e-c9e7-48fc-a64f-0c3a73ce8214 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:56.214499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:56.215372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:56.215810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:56.216252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:56.217182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:56.217637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:56.219810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210d05-3ed4-46c4-9f51-a0d0175ef810 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:56.239722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 251/503] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:56.241352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:56.255937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d702ac-b164-430d-8a9d-090b38f5ec5f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:56.260502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:56.261220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:56.261571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:56.261951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:56.262855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=2bd1472455034b3884be9c92d21c591f) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:56.263341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:56.265245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc493e30-1df8-4d58-b58e-9a594e3fcebb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:56.275217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 253/504] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:56 2021] GET /identity/v3/role_assignments?user.id=2bd1472455034b3884be9c92d21c591f&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:57.363947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621924-e93b-4e64-83e6-763dabb3b6a7 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.364502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621924-e93b-4e64-83e6-763dabb3b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.364597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621924-e93b-4e64-83e6-763dabb3b6a7 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.366736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 252/505] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:57.372159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.372642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.372718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.399960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:57.401144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:57.408755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 254/506] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:28:57.452849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5621924-e93b-4e64-83e6-763dabb3b6a7 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.468545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5621924-e93b-4e64-83e6-763dabb3b6a7 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.472766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.473574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.473858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.474134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.488801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:57.495835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:57.497451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 253/507] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:57.503495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.514066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1337e8-f189-4d35-b2f5-d61e1c6fb1d1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.523063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.523746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.524032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.524315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.525080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:57.525390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.527034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.539376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 255/508] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:57.545061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.554450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112b6c-06da-44ee-8563-b28bef5ecf1c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.567515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.568678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.569183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.569675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.585357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.591956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.617510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:57.619151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 254/509] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:57.625005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.645387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f020f7-e050-4796-bf41-f1fa638d5e7c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.654881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.655579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.655862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.656137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.656867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:57.657172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.658773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.681588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 256/510] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:57.687168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.697232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bb63f-9aad-45fc-a5b3-bd9e394ce13a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.708395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.709611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.710152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.710649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.721416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.724515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.745655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:28:57.751480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 255/511] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:57.757640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.771789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666e8a-4cde-42f3-99e7-702f041d5f29 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.779249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.779955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.780240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.780519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.781400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:57.781710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.783694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.818246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 257/512] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:57.823885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.838938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6255ba-3184-4359-9040-235e148f4ebc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.849548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.850659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.851229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.851730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.863588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.865708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.885226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 256/513] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:57.895388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.917165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6208c-5b8a-4cf9-80ae-c2e03ea6afa6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:57.931705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:57.933083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:57.933574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:57.934075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:57.946230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:57.948541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:57.976415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:57.978032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 258/514] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:57.984009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:57.993053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555b5c-99be-437b-a063-d6750d80db93 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.003325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.004477 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.004965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.005473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.006395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.006984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.008861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.024141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 257/515] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.029469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.042118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65519ee5-ce1f-4c5f-b463-0314eec3809b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.047025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.048232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.048763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.049289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.067873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.070456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.094733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-b11b76c7-6404-4d75-b917-980aecc8a953 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:58.096346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 259/516] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:58.102535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.116140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543f3d-fa55-4cad-a592-9eb5be5a45d8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.120050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7517eb-976a-49a3-b997-78373658b544 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.120321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7517eb-976a-49a3-b997-78373658b544 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.120590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7517eb-976a-49a3-b997-78373658b544 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.122672 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 260/517] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:58.127731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.128455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.129198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.129488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.129597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.129848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.130032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.130642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.130987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.132875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.155916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:58.162943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:58.164322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 258/518] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.170140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.171305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 261/519] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:58.181834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f10-5002-481a-992f-b10df137e7cc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.186428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.187178 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.187465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.187743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.188662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=3b41f9cf1fe54552abe59a56251cfa7b) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.188974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.192239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d6c8-4c51-449a-b1c6-ce2aedbef968 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.199516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 259/520] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/role_assignments?user.id=3b41f9cf1fe54552abe59a56251cfa7b&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:58.219686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.234952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769c707-ee75-4d06-b536-ed701b47b48d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.246972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac93e89-00b0-4334-90e1-cf9e1b8a92a2 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.247287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac93e89-00b0-4334-90e1-cf9e1b8a92a2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.247629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac93e89-00b0-4334-90e1-cf9e1b8a92a2 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.249939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 260/521] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:28:58.251163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.251990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.252271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.252548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.257277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.257537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.257757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.273477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:58.281017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:58.282284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 262/522] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:58.291221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.299662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64284ab-824b-4d7d-8ecb-1a2059b1a2bc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.301200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:58.302868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:58.306940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.306940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.306940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.306940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.307418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.307418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.308629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.319910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 263/523] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:58.325902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.326988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 261/524] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:58.335931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d37d1f-a11c-4a52-8f72-587c2ddf78c1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.340767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.341698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.342007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.342367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.368790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.370722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.390061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:58.392469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.392935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 264/525] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:58.397882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.402901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80a2f-c0a3-498c-8366-49262c7d6141 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.408915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3aeb6-14ad-4fc1-83c6-8330a4d83393 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.413599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.414276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.414648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.414950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.415799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.416107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.417729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.419266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.420422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.420909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.421441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.434322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:58.439341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 265/526] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:58.439341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.448075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f771d5-f761-4e33-8f55-1b0d0053c3c1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.449313 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:58.451597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 262/527] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:58.453031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.453957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.454332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.454702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.457646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.465262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.466867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.469487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc639-23ad-4bc4-a798-846ec924a052 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.474145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.475345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.475833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.476321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.477310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.477862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.479766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.481591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 08:28:58.487765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 266/528] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:58.489831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.491356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 263/529] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:58.499976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.510142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb05b-8957-4100-a532-57ea6a3a1b90 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.512927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7076-5b75-4df3-8e48-72be9ffc4d85 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.519665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.519998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.520681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.520969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.521246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.521665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.522097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.522420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.522653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.523182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.524325 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.538433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.540933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.546271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 267/530] 10.222.0.66 () {56 vars in 1159 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.553199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.562219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc156-69a7-4c59-920b-949f26496c3a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.562730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:58.564614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 264/531] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:58.568892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.569843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.571020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.571311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.571608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.580075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.581962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.583959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9ed1d-cdfb-4b68-ba7c-bcc185896aeb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.590450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.591565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.592008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 268/532] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:58.592306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.592786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.593794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.594311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.596315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.598481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.607756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b74e6-a350-46bc-b53f-46e66445486f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.612002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 265/533] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.613926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.615456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.615456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.615456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.618529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.634065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.635823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfaf5f-39dc-4170-ab8c-2ecd0fe9ccd7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.636683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.647145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.647940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.648198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.648467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.657352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:58.657654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.659551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 269/534] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:58.663360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.665377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.679065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49634cd1-a3bc-4b8c-8de8-2e20c48f24fe admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.684622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.685598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.686151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.686626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:28:58.686843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.687937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.688214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 266/535] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:58.688677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.690680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.695302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.706785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52bc84-253c-4a9f-9b14-e652f2bad103 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.707658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 270/536] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:58.713774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.720759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.722084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.722612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.723205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.724248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b589808-480a-4c33-892a-69da1cfd1324 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.724588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.725227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.727711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.729394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.730460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.730894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.731290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.739671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.742006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.753696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 267/537] 10.222.0.66 () {56 vars in 1159 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:58.757436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.758317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:58.759944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 271/538] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:58.771176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.773723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cc49b-8359-412d-8b3a-f1e4f47485ba admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.778309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.779220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.779649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.780098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.782072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248c2d-b7c1-4d92-924e-9a1dd130043b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.790070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.790845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.791601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.792187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.792641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.793606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.794085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.794627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.797547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.809411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 268/539] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:28:58.810889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.813885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 272/540] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.820409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.823835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251063cb-f453-4433-8f23-cde2afb6e995 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.828447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.829479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.829909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.830331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.830650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576479f6-7ae7-49dc-88f2-de5c69a869b7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.836185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.836969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.837362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.837746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.838687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=c2227b93e13c4a418b506b2a2c011c76) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.839148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.841608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.844373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.846451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.853441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 273/541] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/role_assignments?user.id=c2227b93e13c4a418b506b2a2c011c76&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.866482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:58.868112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 269/542] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:58.877324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.888160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d526b-6d54-4507-812d-c88e30fcce36 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.901019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.901689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.901966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.902235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.902991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:58.903299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.904896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a132a48-b2d3-45d3-a906-368531a85638 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.930776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 274/543] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:58.937061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:58.957669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdd5e1-f873-43ee-a8f3-356bd769809b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:58.966716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:58.967633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.968017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.968301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.977087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:58.979133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:58.990150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc471-5528-4494-b970-53585f6d1d92 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:58.990781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc471-5528-4494-b970-53585f6d1d92 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:58.991293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affc471-5528-4494-b970-53585f6d1d92 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:58.993297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 275/544] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:58.995128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:58.995128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 270/545] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.005610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.020255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.020572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5d12b-b3af-4c25-9072-dcf6df3f6636 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.021083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.021726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.031714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.033103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.033402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.033733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.039458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.039801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.047936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.067966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:59.069725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:59.070449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 271/546] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.080098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.086186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 276/547] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:28:59.094781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcdf2f-84f4-44ad-bd82-cc535f93c731 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.102306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.103576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.104145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.104721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.106498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=679ea61fafe040cdb5235aae7ff59f81) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.107139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.111203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.122592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.123262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 272/548] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/role_assignments?user.id=679ea61fafe040cdb5235aae7ff59f81&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.137423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3dbfd-0b10-4b70-9eb6-205cc3513fd3 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.151861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.153067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.153566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.154156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.170113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:59.177938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:59.182277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 277/549] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.190037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.202771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f008-e605-465b-960a-39befa595029 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.208289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.209032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.209320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.209596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.210369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.210681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.212480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0b813-dddc-4b8d-a4f8-6034a8feeae0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.222398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 273/550] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.228168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.241403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694cde-a36d-4f6c-82a2-fc5775377eb0 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.241403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694cde-a36d-4f6c-82a2-fc5775377eb0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.241677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694cde-a36d-4f6c-82a2-fc5775377eb0 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.244109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 274/551] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:28:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:28:59.249927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.250538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.250819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188075-98ac-4fc1-beed-0453f03f1cbe admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.251397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.257374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.258359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.258645 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.258980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.275401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.276869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:28:59.277338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.278754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:28:59.288306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 275/552] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:28:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 13 08:28:59.307105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:59.309018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 278/553] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.317135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.325423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.328046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9fec8-782a-4725-85da-fec834d2e990 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.340077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f71b-1496-48b9-bae9-36ff420a900c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.340796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.342245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.342893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.343538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.345036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.345177 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.345703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.345999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.346360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.347332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.349879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.364662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:28:59.366438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 276/554] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.372904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.373063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:28:59.374529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 279/555] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.382003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.392932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237d42-fcbf-4b61-993a-dbda823344bc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.394091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545959e-dbbd-49b1-bd72-46cdcc2ebc42 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.401345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.402029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.402312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.402587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.403437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.403761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.405383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.406402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.407617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.408122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.408645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.422250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 280/556] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:59.425229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.425995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.426992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.438405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65390eb5-0173-4eb5-bac5-ea6aaac1edd0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.443438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.444288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.444574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.444848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.448185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 08:28:59.450083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 277/557] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:59.457561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.464319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.467194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.468953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbea2f-0419-48a4-b165-4ec82cc43354 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.478987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.480745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.481633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.482249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.483889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.484481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.488952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.491172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:59.497447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 281/558] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:59.499093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.509226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbfc0-cee4-4f88-b340-691516f67091 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.514083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.515127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.515594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.516093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.517055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.517616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.520644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.526447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 278/559] 10.222.0.66 () {56 vars in 1161 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:59.535688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.543044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 282/560] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:59.545571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.555646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454469e5-e94c-492a-bf69-55d67e9b9686 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.560248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e9e5-850f-4a07-b173-6a8242cc6366 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.562856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.563945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.564562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.565076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.565441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.566510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.566799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.567212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.575814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.576681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.578021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.579522 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.591321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 279/561] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:28:59.595496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:28:59.598180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.602858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 283/562] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:59.607455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3681-ec32-4606-89e8-a3b07d65e6f1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.608339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.614564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.615998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.616499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.617570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.621581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e1800-922c-4a09-a412-f17711793812 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.626633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.627411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.628314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.628565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.629944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.630260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.631997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.632520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.634629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.655533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 284/563] 10.222.0.66 () {56 vars in 1157 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:59.658697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:59.661162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 280/564] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:28:59.665686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.666833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.675600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f8089-668e-48bb-87fe-6ec5e66e38e9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.677956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4fec-dedb-4174-8379-a192230bee84 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.680083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.680976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.681259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.681534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.684061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.685385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.685940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.686423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.687488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.688057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.689953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.700123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.703670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.706339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 281/565] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.715634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.729747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:28:59.731375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 285/566] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.733337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f01ff-aaef-4fa4-bbd0-fedf08a011f2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.740667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.748539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.749406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.749817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.750094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.763386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7d58-6eef-46b5-9c5c-59336fe7f33a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.766197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.770827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.775675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.777792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.778010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.779911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.780661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.781007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.786880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.798511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:59.803152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 286/567] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.812921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 282/568] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.819508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.821691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.850889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458acff-a43b-403f-946c-d3c8d6976350 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.855795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f409b-1d74-4f91-a96e-d8f4309427cc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.863566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.865057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.865340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.865644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.867639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.868464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.868743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.869047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.870005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.870344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.872790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.883229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.885283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.906306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:28:59.907897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 287/569] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:28:59.909718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 283/570] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.915755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.916969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:28:59.925887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09c41e-a6cc-4ba4-87ae-e8801ccf1d6e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.930395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.931091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.931378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.931659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.932502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=e987011ba5584a8985871401a7cc5923) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.932802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.934697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.937345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665f1c-3ff2-4415-b0d3-8b456bd34e7d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:28:59.942799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 288/571] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/role_assignments?user.id=e987011ba5584a8985871401a7cc5923&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:28:59.953672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:28:59.954632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:28:59.955205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:28:59.955507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:28:59.957251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:28:59.957656 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:28:59.960084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f583-3b3d-4c7c-9abe-72dcc210971e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:28:59.983906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 284/572] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:28:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:28:59.991143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:00.002850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb4cf-4c38-46a2-9a77-3f6bbbc8dc9e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:00.008545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd9dc5-dd27-42db-95dd-c48e7bd0d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:00.010628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd9dc5-dd27-42db-95dd-c48e7bd0d9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:00.011162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd9dc5-dd27-42db-95dd-c48e7bd0d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:00.011667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd9dc5-dd27-42db-95dd-c48e7bd0d9c9 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/2bd1472455034b3884be9c92d21c591f/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:00.031424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd9dc5-dd27-42db-95dd-c48e7bd0d9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=2bd1472455034b3884be9c92d21c591f, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:00.034284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd9dc5-dd27-42db-95dd-c48e7bd0d9c9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:00.059125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 289/573] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:28:59 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/2bd1472455034b3884be9c92d21c591f/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:01.208733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3701be9-6986-4dae-9b1d-9739c07db953 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.209458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3701be9-6986-4dae-9b1d-9739c07db953 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.209458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3701be9-6986-4dae-9b1d-9739c07db953 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.211460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 285/574] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:01.224879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644168c0-200d-42b4-b610-2578777fd727 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.225524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644168c0-200d-42b4-b610-2578777fd727 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.225524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644168c0-200d-42b4-b610-2578777fd727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.260745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-644168c0-200d-42b4-b610-2578777fd727 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:01.261903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-644168c0-200d-42b4-b610-2578777fd727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:01.342287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 290/575] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:01.379377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3701be9-6986-4dae-9b1d-9739c07db953 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.397260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3701be9-6986-4dae-9b1d-9739c07db953 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.401446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.402229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.402506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.402771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.423927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:01.430811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:01.432267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 286/576] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:01.437904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644168c0-200d-42b4-b610-2578777fd727 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.447098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644168c0-200d-42b4-b610-2578777fd727 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.454807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.455510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.455786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.456763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.457600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:01.457909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.459612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.474939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 291/577] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:01.480225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.491568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f194-9ca4-426c-afd2-abf17199cc50 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.496156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.496686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.496968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.497241 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.515243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.517102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.540192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:01.541428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 287/578] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:01.550793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.564008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cd7b0-7d9b-4b7c-a345-3e35aaf7bfeb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.572944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.573620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.573901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.574169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.574897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:01.575223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.576820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.608926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 292/579] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:01.616911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.633187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2120d7b-6d9a-45d0-972e-3de29eff4510 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.642396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.643224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.643566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.644031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.664467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.666525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.691517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-3293292b-e497-4686-b3c7-087ad6c510e4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:29:01.699084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 288/580] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:01.702517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.729574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a136e6-c591-49ec-97a9-153e62250fdf None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.729908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35562652-542c-4134-b132-371ef0c2911f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.730098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a136e6-c591-49ec-97a9-153e62250fdf None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.730098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a136e6-c591-49ec-97a9-153e62250fdf None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.732167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 289/581] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:01.739102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.739454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.739682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.743472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.744244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.746817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.747154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.748510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:01.748824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.750757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.776336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:01.777521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:01.792192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 293/582] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:01.795976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 290/583] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:01.797087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.812334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc7fc7-96ec-4928-9da7-5ca8d722ac0c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.818730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.819473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.819756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.820028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.822658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.833046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7f3d-63fc-48ec-aa19-72b62aaa5431 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.836818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.838574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.845627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.846519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.846864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.847157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.849074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 294/584] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:01.859974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.862213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.864279 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.868643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798fbc1-4ad4-4492-af5e-4276c903be10 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.884092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:01.885604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 291/585] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:01.885795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.886569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.886850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.887163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.903662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.903849 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.905738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.919513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a970646-4909-424b-a40d-54f22308ce9d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.923290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:01.924092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 295/586] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:01.930295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.930524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.931472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.931930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.932373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.933287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:01.933760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.935563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.940118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ea75-557d-4875-bbd1-69c79f60c805 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.944911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.945656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.945937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.946209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.947008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:01.947312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.950931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.957766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 292/587] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:01.966081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 296/588] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:01.972004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.972144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:01.981380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102544e-690b-4bdf-abc9-1c719f8239f0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.985578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:01.986286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:01.986568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:01.986887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:01.987723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:01.988236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7788d-0553-4c98-a838-0ad9200ddc3c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:01.989751 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:01.999535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.000332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.000616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.000895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.016063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:02.017067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 297/589] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:29:01 2021] POST /identity/v3/users => generated 254 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:02.018053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:02.035266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:02.037299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 293/590] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:02.044002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.060005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75ca72-1ab4-4fa1-b107-d0845fa567b6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:02.073164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.073842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.074128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.074405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.075232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:02.075544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:02.077413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58902fe6-52b9-4dd8-9c7e-033d475ac8a5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:02.096967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 298/591] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:02.103049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.113530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8301e0-21ec-4cb4-88f0-9ec23033be25 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:02.129785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.130470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.130755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.131067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.131922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=3b41f9cf1fe54552abe59a56251cfa7b) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:02.132239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:02.134139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172f30e-a803-40c2-843c-ec9c5a34813a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:02.149410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 294/592] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/role_assignments?user.id=3b41f9cf1fe54552abe59a56251cfa7b&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:02.574078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11116e8-32c4-4d3d-9e63-be500761cd93 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.574590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11116e8-32c4-4d3d-9e63-be500761cd93 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.574693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11116e8-32c4-4d3d-9e63-be500761cd93 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.576539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 299/593] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:02.593193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.594025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.594450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.622936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:02.624338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:02.637995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 295/594] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:02.670254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11116e8-32c4-4d3d-9e63-be500761cd93 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.688868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11116e8-32c4-4d3d-9e63-be500761cd93 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:02.696350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.697330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.697761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.698181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.698996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:02.700165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:02.700165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:29:02.700165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:29:02.701321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:02.720134 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:29:02.722440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 300/595] 10.222.0.66 () {56 vars in 1151 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:02.728517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.740226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b83bb-1990-4bbb-8a72-86fa5b0f4c11 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:02.748413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.749272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.749705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.750146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.751038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:02.751496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:02.752952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:02.752952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:29:02.752952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:29:02.754171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d35d6c-0c84-46bb-9af8-52fbffc0d48e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:02.763614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 296/596] 10.222.0.66 () {56 vars in 1146 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:02.770031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.784772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c76a-672a-42f7-bfd0-cea9f836357f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:02.793009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.793689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.793968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.794237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.794970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:02.795283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:02.796285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:02.796285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:29:02.796285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:29:02.797185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bedbbf-7456-4fe3-aebf-d376fe68fec9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:02.809095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 301/597] 10.222.0.66 () {56 vars in 1146 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:02.838329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403e3b-4fc7-42b5-94b1-f2b504966344 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.838535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403e3b-4fc7-42b5-94b1-f2b504966344 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.838713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403e3b-4fc7-42b5-94b1-f2b504966344 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.840902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 297/598] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:02.847388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.847669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.847942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.868512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1899a-d303-4d38-beff-6d80d598ae09 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.868791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1899a-d303-4d38-beff-6d80d598ae09 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.869064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1899a-d303-4d38-beff-6d80d598ae09 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.871094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 298/599] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:02.873642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:02.874837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:02.884771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.885401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.886012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.895208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 302/600] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:02.910755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:02.912193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:02.918699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.922508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 299/601] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:02.932171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bf0f9-87bd-47c0-aecb-445b50f3ba82 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:02.948376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:02.949383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:02.949764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:02.950151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:02.969773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:02.977483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:29:02.978971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 303/602] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:02.986226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.986406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:02.999575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b2f8-60e1-4059-94f7-76a14b35d438 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.003594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7de74-86e0-47e5-a441-5b876ea8c0dd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.012381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.013616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.014849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.015464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.015889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.016300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.017334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.017757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] PATH_INFO: `/v3/services/network` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.018653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.020772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.021303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.023860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:03.023860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:29:03.023860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:29:03.025171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.025668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.048229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:29:03.051421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 304/603] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:03.053111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 300/604] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:02 2021] GET /identity/v3/services/network => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:03.059477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.071559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.073339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09c59-a89a-4525-bb2b-85e0ca02b5ec admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.081768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33baee-a8cb-4627-bb99-f01879376c7f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.082139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.083073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.083529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.084048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.085165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.085709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.086719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.087625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.087977 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.088100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.088514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.095028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 305/605] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:03.101430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.102115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.103721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.111538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145859a-c19a-446b-b87c-9459f1faf2d3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.118979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.119655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.119934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.120657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.120912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] RBAC: Adding query filter params (type=network) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.121219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.122809 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.126366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:03.128870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 301/606] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:03.133754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 306/607] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/services?type=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:03.135137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.145355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46349bdd-5d34-495d-94f5-863894243fd5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.150270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.151273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.151728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.152169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.153093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.153549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.155504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.170220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 302/608] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:03.176899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.186899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2990a-912c-4308-a423-5611c1f1c692 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.193445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.194586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.195038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.195520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.204630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.207105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.221932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:29:03.223773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 307/609] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:03.229611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.254838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8aa28-34f5-4325-a2ce-f1796f28d88c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.260888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.261622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.261904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.262174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.263084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.263387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.265366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.293426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 303/610] 10.222.0.66 () {56 vars in 1157 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:03.299377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.309449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf46e1-393f-4d65-ad39-079b25fee209 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.319022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.319687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.319965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.320239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.330014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.332552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.349604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 308/611] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:03.355051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.367302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67efac1-a0de-41e6-9faa-14ff56047f0a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.372236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.373097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.373421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.373698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.390546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.392458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.417975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:03.419496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 304/612] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:03.425294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.433695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96230b-88d2-40e0-90dd-b569e22152db admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.441307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.442009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.442286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.442558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.443405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.443713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.445410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.457805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 309/613] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:03.463239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.472947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb82d32-43c2-4506-8d73-a9bf1e3096f9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.480240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.481091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.481371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.481644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.491155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.493268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.509928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:03.511160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 305/614] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:03.516890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.526614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b504de-8fc7-4e70-a56d-2a9a6b1bbf69 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.536577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.537255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.537537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.537855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.538740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.539077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.540976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7a17-2c8f-4035-86e4-a24d64796b37 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.554508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 310/615] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:03.560407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:03.575906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea4cc-a6e8-49b0-a219-ce7d23e0f220 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:03.580211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:03.581637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:03.581981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:03.582307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:03.583163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=2bd1472455034b3884be9c92d21c591f) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:03.583517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:03.585427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eeab4d-7974-4539-a167-cc5da928ecb0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:03.592282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 306/616] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:03 2021] GET /identity/v3/role_assignments?user.id=2bd1472455034b3884be9c92d21c591f&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:04.838223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf4855-eefa-4340-af92-dc7a72eff323 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:04.838744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf4855-eefa-4340-af92-dc7a72eff323 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:04.838744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf4855-eefa-4340-af92-dc7a72eff323 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:04.840718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 311/617] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:04.847537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:04.848521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:04.849011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:04.879582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:04.881133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:04.893038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 307/618] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:04.917914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf4855-eefa-4340-af92-dc7a72eff323 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:04.931895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf4855-eefa-4340-af92-dc7a72eff323 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:04.936855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:04.938109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:04.938636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:04.939213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:04.958470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:04.965877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:04.967687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 312/619] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:04.974451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:04.986573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdda9f-daac-4b38-9ccb-dc3781338e7a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:04.994808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:04.995852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:04.996367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:04.996847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:04.997821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:04.998334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.000193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dfd7e-204f-4a2f-94ce-8cfbac03881d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.014751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 308/620] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:05.021528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.035746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95135-3e4d-44eb-ab14-bd47b5b0ef8a None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.035928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283521-ffbc-402c-bd21-cbd25e6102e9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.036613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95135-3e4d-44eb-ab14-bd47b5b0ef8a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.037117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95135-3e4d-44eb-ab14-bd47b5b0ef8a None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.039210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 309/621] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:05.043127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.044146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.044334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.044571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.045989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.046486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.047009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.062796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.064691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.068572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:05.069987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:05.089965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:05.092827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 310/622] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:05.094467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 313/623] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:05.099922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.116239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7694-1f19-4763-a03c-c62983d012f6 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.124337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.125263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.125773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.126250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.127236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.128579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.130566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.146442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 311/624] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:05.152139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.162226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49ae8b-7dca-4d90-990f-a003b5e1470b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.167323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.177138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.178255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.178745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.179263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.182172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503c984-4f40-42c1-9061-3e8b4390c7d9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.194062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.196752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.198049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.199119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.199608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.200083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.219896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:29:05.221787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 314/625] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:05.222768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:05.227071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.235827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:29:05.243236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ec4f4-939b-4b75-acb0-2031da564d06 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.243928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 312/626] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:05.250808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.259270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.260059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.260540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.260926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.261779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.262087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.263983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.272620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e29e8-4862-4629-b3ca-a7261daaccd9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.282726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.283426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.283705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.284065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.285118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.285424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.287058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.297360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 313/627] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:05.303752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.305285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 315/628] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:05.310821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.313143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a597909-80c3-465d-9939-98eef5e62065 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.322957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.322957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.322957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.322957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.332415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.333171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5ee86-9b28-40e0-a54a-dce52a51b369 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.334603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.344790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.345520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.345800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.346114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.355432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:05.357518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 314/629] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:05.364333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.373055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.374612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20fb70-835a-4f04-b9bb-55721c77cdb6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.374951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.384571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.385305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.385593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.385868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.386693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.387026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.390047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.415405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:05.416759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 315/630] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:05.417580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 316/631] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:05.422273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.423960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.436543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dae9a-71df-418e-aae6-39dd18a9215d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.438491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.439510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.440950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.441720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.443568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3015a-0669-44a1-ae10-bca63b9b45b1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.451199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.453492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.456860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.457544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.457878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.458153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.458871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.459204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.460807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.470015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:29:05.472084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 316/632] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:05.478363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.484653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 317/633] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:05.489813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d416-4dd7-4580-8000-50c197b2aa0e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.491696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.494296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.495051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.495461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.495746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.496627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.497001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.498948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.511260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8d3be-c39a-4679-89cd-2e7e3bb711a3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.523187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.525448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.525729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.526055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.536115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 317/634] 10.222.0.66 () {56 vars in 1171 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:05.544688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.546839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.548990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.567323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0042355-3bfb-4697-9254-cf79850ca94f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.578105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.578828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.579155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.579429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.582359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:05.583924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 318/635] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:05.589682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.590024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.591754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.603185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 318/636] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:29:05.610030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.617244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c27f-fa5e-453a-8a3e-913fda6ce66b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.619658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b2723-35ca-4bad-b4bc-882eb954a391 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.624212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.624454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.624873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.625064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.625218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.625364 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.625508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.625650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.626178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.626482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.628955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.641762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.645572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.659962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 319/637] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:05.666363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.675844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-a06f86e1-7dbe-4e02-94e8-6b7530dfbb19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:05.676426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647aa2-57da-4092-91af-bec2b62633b4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.677350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 319/638] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:05.678714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9098f8-ec02-400a-9108-f4c0a0a3fb1b None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.679016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9098f8-ec02-400a-9108-f4c0a0a3fb1b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.679288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9098f8-ec02-400a-9108-f4c0a0a3fb1b None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.681180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 320/639] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:05.685908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9098f8-ec02-400a-9108-f4c0a0a3fb1b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.687566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973a0c-0355-47c1-bcc4-c12b5a456618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.688694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973a0c-0355-47c1-bcc4-c12b5a456618 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.689064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973a0c-0355-47c1-bcc4-c12b5a456618 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.689454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973a0c-0355-47c1-bcc4-c12b5a456618 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/3b41f9cf1fe54552abe59a56251cfa7b/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.692463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a973a0c-0355-47c1-bcc4-c12b5a456618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=3b41f9cf1fe54552abe59a56251cfa7b, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.696531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a973a0c-0355-47c1-bcc4-c12b5a456618 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.698104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9098f8-ec02-400a-9108-f4c0a0a3fb1b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.702602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.703276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.703553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.703824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.704531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.704829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.707050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.713957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 320/640] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:05 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/3b41f9cf1fe54552abe59a56251cfa7b/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:05.716094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.716633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.717153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.719100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 321/641] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:05.726036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.738713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e1bcd-5ab0-467c-b842-f7ab8bc93bee admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.741515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:05.742856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:05.806141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 321/642] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:05.812530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.813402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.813792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.814070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.822706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.824916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.831127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.840726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896e12-9b2a-4a6c-83db-b2c14dbe0ead None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.842533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:05.844242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 322/643] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:05.848431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.849340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.849949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.850225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.850984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.851477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.852485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:05.852485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:29:05.852485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:29:05.853688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.861411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf3e43-c45e-4fcb-86e6-74c9253357f6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.868049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.868857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.869051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.869317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.870427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.870736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.872716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3034b7-2d98-4983-994e-61139ea576b9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.874735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 322/644] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:05 2021] POST /identity/v3/services => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:05.888124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 323/645] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:05.895704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:05.905592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fc20d-a980-4ff5-a781-24985b6bc00b None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.905944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fc20d-a980-4ff5-a781-24985b6bc00b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.906169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fc20d-a980-4ff5-a781-24985b6bc00b None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.908258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 324/646] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:29:05.921043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1770c-8a79-47b5-b4bc-bd0f9ae0e4ff None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.921386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1770c-8a79-47b5-b4bc-bd0f9ae0e4ff None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.921671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1770c-8a79-47b5-b4bc-bd0f9ae0e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.941733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ad53-0b1c-400b-b021-cf8c6209b3f4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:05.947350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:05.948033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:05.948315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:05.948815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:05.949768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=6ace03f84bc34083bab532ff1e84f09a) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:05.950081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:05.952420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:05.960326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 323/647] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:05 2021] GET /identity/v3/role_assignments?user.id=6ace03f84bc34083bab532ff1e84f09a&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:05.961488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a8f1770c-8a79-47b5-b4bc-bd0f9ae0e4ff None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:05.962743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a8f1770c-8a79-47b5-b4bc-bd0f9ae0e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:05.991316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 325/648] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:05 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:06.028229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:06.039008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866de66e-df82-4c2c-bd82-4221456dc61d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:06.044826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545081a-5b71-4275-80be-876004558eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:06.045658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545081a-5b71-4275-80be-876004558eee admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:06.045949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545081a-5b71-4275-80be-876004558eee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:06.046275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545081a-5b71-4275-80be-876004558eee admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:06.047083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545081a-5b71-4275-80be-876004558eee admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:06.048898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545081a-5b71-4275-80be-876004558eee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:06.069723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 324/649] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:06 2021] POST /identity/v3/services => generated 240 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:06.776012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602945-1afc-4560-a431-a1d76e40fdd7 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:06.776358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602945-1afc-4560-a431-a1d76e40fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:06.776693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602945-1afc-4560-a431-a1d76e40fdd7 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:06.778751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 326/650] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:06.785011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:06.785290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:06.785569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:06.808853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:06.810012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:06.833013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 325/651] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:06.876632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd602945-1afc-4560-a431-a1d76e40fdd7 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:06.904728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd602945-1afc-4560-a431-a1d76e40fdd7 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:06.916742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:06.918117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:06.918629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:06.919179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:06.944456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:06.957891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:06.960341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 327/652] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:06.966157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:06.983131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c960-2f7a-46b9-9e76-4f3273fb6f9d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:06.993103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:06.994148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:06.994635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:06.995151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:06.996098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:06.996598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:06.998489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.014509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 326/653] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:07.021356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.036085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952b52a-78ae-4133-a7f5-983fcc4878a8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.046332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.047166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.047494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.047769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.062657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.064608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.085493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:07.087034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 328/654] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:07.092753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.111693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea1c39-3718-4732-971c-8e58c204add5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.122931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.123913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.124392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.124858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.125794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:07.126296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.128951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.147017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 327/655] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:07.148927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.162252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba8c50-607f-4c1f-a632-766be47fd6f2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.172619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.173424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.173759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.174038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.187436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.189535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.209202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:29:07.210423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 329/656] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:07.216574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.236132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908b78-f8f3-44f9-a043-beb6b7129c75 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.250352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.251075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.251361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.251633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.252472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:07.253483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.255670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.282611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 328/657] 10.222.0.66 () {56 vars in 1157 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:07.288422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.297676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc442-572a-4dc8-903b-9864e2481faa admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.310315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.311038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.311320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.311599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.320743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.322693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.336863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 330/658] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:07.342830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.356324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3932f-d82d-4438-af43-7cb39637ca15 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.367334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.368142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.368433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.368713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.388934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.390799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.413778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:07.415326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 329/659] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:07.420738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.429591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1836-7086-4263-b906-af86eed9bf05 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.442066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.442743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.443052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.443331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.444122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:07.444430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.446095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.466348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 331/660] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:07.472555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.492884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a927a-2061-44af-b1c1-4f209ac9f32b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.499046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.499839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.500119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.500392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.516126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.518152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.536587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:07.537799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 330/661] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:07.543877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.553832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abf79c-e41c-4c29-94ad-3761e485dd1f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.570135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.570874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.571193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.571468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.572268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:07.572575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.574482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8531a3-12a3-4203-83b7-8dc511159ea8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.592355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 332/662] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:07.598623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:07.611556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd51c90-f31d-41ca-b260-efb7542c9b78 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:07.622478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:07.623155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:07.623438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:07.623716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:07.624554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=2bd1472455034b3884be9c92d21c591f) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:07.624869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:07.626727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255355-bade-432e-bec8-87c28de8f1f1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:07.639568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 331/663] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:07 2021] GET /identity/v3/role_assignments?user.id=2bd1472455034b3884be9c92d21c591f&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:08.587168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d49ba7-4ca4-4555-9ca2-7d3694cb92a4 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.587691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d49ba7-4ca4-4555-9ca2-7d3694cb92a4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.587691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d49ba7-4ca4-4555-9ca2-7d3694cb92a4 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.589857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 333/664] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:08.595796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.597108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.597108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.614887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:08.616078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:08.631031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 332/665] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:08.649562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d49ba7-4ca4-4555-9ca2-7d3694cb92a4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.662135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d49ba7-4ca4-4555-9ca2-7d3694cb92a4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.666387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.667212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.667492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.667765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.679733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:08.686841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:08.693335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 334/666] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:08.694728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.703391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e2018-4ca3-4dd9-a850-a52577ee27e3 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.707950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.708696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.708976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.709247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.709999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:08.710348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:08.712000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:08.727020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 333/667] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:08.728445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.743487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecdf5-63e2-4c43-a846-73bedec2fcda admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.750780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.751661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.751938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.752209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.763670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:08.765531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:08.792933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-5ca0b045-26b6-4a1c-b6a5-d8f299bb5cb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:08.794162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 335/668] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:08.800626 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.809950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c972-d8c6-4395-b723-16acdb86c7f7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.815073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f915-2240-4c7c-9619-772cbcbdcc81 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.815402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f915-2240-4c7c-9619-772cbcbdcc81 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.815757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729f915-2240-4c7c-9619-772cbcbdcc81 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.816229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.816915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.817216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.817498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.818013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 336/669] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:29:08.818229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:08.818539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:08.826939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:08.832621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.833129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.833621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.837621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 334/670] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:08.842882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.862727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe829e42-8ead-4062-830e-b3315459ac1d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.867920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:08.870498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:08.876501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.877706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.878171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.879401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.889237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 337/671] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:08.893491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:08.896205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:08.914892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.918772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-54a9d1aa-b6e1-4f23-8208-4f83942b26b3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:29:08.920242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 335/672] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:08.922693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ed346-ca33-4b99-8aa5-bbc85a6a92d5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.922693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ed346-ca33-4b99-8aa5-bbc85a6a92d5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.922693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ed346-ca33-4b99-8aa5-bbc85a6a92d5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.923944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 336/673] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:08.930184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ed346-ca33-4b99-8aa5-bbc85a6a92d5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:08.931486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c8acc-5b58-4962-a1c7-ce47127be525 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.939133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd711364-d291-4b7f-83b3-04720f72cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.940737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd711364-d291-4b7f-83b3-04720f72cfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.940961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd711364-d291-4b7f-83b3-04720f72cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.941304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd711364-d291-4b7f-83b3-04720f72cfc4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.945499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ed346-ca33-4b99-8aa5-bbc85a6a92d5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:08.954831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:08.957268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.957900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.958388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.959509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:08.959648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd711364-d291-4b7f-83b3-04720f72cfc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:08.960152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:08.965801 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:08.967577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-dd711364-d291-4b7f-83b3-04720f72cfc4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:29:08.974503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 338/674] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:08.976188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25638c-0e70-41e6-a81d-fde31545df52 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:08.976551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25638c-0e70-41e6-a81d-fde31545df52 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:08.976907 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25638c-0e70-41e6-a81d-fde31545df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:08.996614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-2c25638c-0e70-41e6-a81d-fde31545df52 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:08.997896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2c25638c-0e70-41e6-a81d-fde31545df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:09.005257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 337/675] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:29:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.010591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.011383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 339/676] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:09.012987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100c7f-7302-4460-85a7-5e706ae72d19 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.013277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100c7f-7302-4460-85a7-5e706ae72d19 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.013555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100c7f-7302-4460-85a7-5e706ae72d19 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.015707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 340/677] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:09.016475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8100c7f-7302-4460-85a7-5e706ae72d19 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.036971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e14c77-ad30-43f3-a7c7-10fcae387ee7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.042135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8100c7f-7302-4460-85a7-5e706ae72d19 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.043320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.044591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.045090 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.045610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.046675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.047236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.047356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.047908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.048183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.048463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.051005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190a4c-fc70-45e2-9873-f0460f33241b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.057247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.059052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.067584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 338/678] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.069401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.069921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.071334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.073202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 341/679] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:09.074054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.083470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d86170-a4a5-42c7-b088-259120c8099f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.087805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.088552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.088836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.089109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.089764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.091413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.103300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:29:09.104525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 342/680] 10.222.0.66 () {56 vars in 1151 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.105312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.107987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:09.109414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:09.119659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ee93-4f08-494c-b57f-8aec74fdc3ad admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.121251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 339/681] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:09.122076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.131362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.131523 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8879e-0fb1-4973-9223-19d80f139262 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.132649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.133098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.133582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.141414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.142202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.142484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.143764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.148586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.150802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.155060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.156968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.169637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:09.176370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:09.176843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 343/682] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.177843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.182044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 340/683] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.182856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.188807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710350a-48c8-48b5-991a-513de44e2415 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.192814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a15be-36d9-4b38-85ed-2384da2c509d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.194286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.195173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.195607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.196160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.197004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.197201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.197641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.198021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.198305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.198629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] PATH_INFO: `/v3/services/network` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.199315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.200053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.200946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.205320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 344/684] 10.222.0.66 () {56 vars in 1146 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.206324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.212926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:29:09.214188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 341/685] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.215001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.223074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39b7b-00a6-4b59-a874-e3153b940fc0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.225271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c2574-af57-4819-9b88-70dbf15c6750 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.228638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.229788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.230260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.230450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.230899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.231221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.231609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.231957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.232450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.232875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.233135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.233278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.235113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.235232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.255166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 342/686] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.256214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.261730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 345/687] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.261730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.265674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5dfd-4266-4d2c-afc9-1b785c1c328c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.271283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.271448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acebc8-aecb-4fce-860f-377b15629500 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.271961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.272231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.272508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.273384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.273704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.275342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.275892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.276606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.276961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.277304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.278087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] RBAC: Adding query filter params (name=network) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.278461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.280176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.285599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 343/688] 10.222.0.66 () {56 vars in 1146 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.285599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.290459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ba779-79ac-4cc6-b755-cb81167be1b7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.296721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 346/689] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services?name=network => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.296721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.296915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.296915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.296915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.296915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.304537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.306497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.307206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4640c-e9bc-4dd1-bbd3-2aa8c0d00485 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.312311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.313431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.313797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.314146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.320619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:09.321988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 344/690] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.322597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.328248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.330286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.341684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9180b-55d3-4c06-a71b-ee116782b659 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.346177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:29:09.350968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 347/691] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.350968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.352907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.355077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.355374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.355655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.357168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] RBAC: Adding query filter params (interface=public, service_id=273c4d3c5ce2423bb1d61a8182d3a877, region_id=RegionOne) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.357489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.358563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:09.358563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:29:09.358563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:29:09.359366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95fc02-a201-42cd-9f19-b2c9b0937b1c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.359556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.364771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.365592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.366036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.366464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.367285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] RBAC: Adding query filter params (type=network) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.367648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.369301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.371289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 345/692] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/endpoints?service_id=273c4d3c5ce2423bb1d61a8182d3a877&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.372310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.381904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b627-b108-4dc6-9db1-df90e28df1e0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.382084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 348/693] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.382734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.387242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.387895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.388179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.388457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.389241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.389551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.391788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.395557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0374039-c258-4343-8e22-bd5ceebf299e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.400663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.401483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.401956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.402372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.403577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.403941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.406402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.407948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 346/694] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.410934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.430153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d56ee4-10be-474f-ad8c-15cb0fae4d6a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.436313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.436878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 349/695] 10.222.0.66 () {56 vars in 1171 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.437387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.437825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.438014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.438447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.439330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.441857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.447755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 347/696] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.448768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.453229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d68c-f3f8-4542-bebf-239c8777cb5c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.461123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60298bd-e235-4533-889c-67f67cd03ce8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.466024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.466765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.466962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.467175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.467563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.468214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.468557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=3b41f9cf1fe54552abe59a56251cfa7b) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.468941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.469103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.469585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.470609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] RBAC: Adding query filter params (interface=public, service_id=861e7bfcd2784035809e7d17764669e5, region_id=RegionOne) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.471230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.471413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.472932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:09.472932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:29:09.472932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:29:09.475043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.478825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 348/697] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/role_assignments?user.id=3b41f9cf1fe54552abe59a56251cfa7b&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.479913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.484896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 350/698] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/endpoints?service_id=861e7bfcd2784035809e7d17764669e5&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.490546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.495049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a31c3-9394-4005-a996-cf84adaf64c7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.500577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.501386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.501665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.501936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.503928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0f0c-5556-4002-88ef-7871ac981394 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.509355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.511115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.511630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.512653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.513914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.514637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.516092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.516659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.523838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 351/699] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/services => generated 772 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:09.554793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:09.556073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 349/700] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.564543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.583615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1de5e-bb77-42c4-8fd1-7d7f1383ff66 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.591346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.593001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.593563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.594073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.595087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.595678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.598369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.621658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 352/701] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.627251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.644987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f888-3680-4911-a353-49b0a745f7c2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.655374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.656199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.656479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.656746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.668075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.670651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.691291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:09.692920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 350/702] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:09.698514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.713957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e34d5-81e6-4bf5-b21d-280d80b28be3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.719451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.720543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.721061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.722289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.723510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:09.724050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.728686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ff781-601d-436d-8145-8a1646cb4c3e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.743753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 353/703] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:09.749374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:09.762265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af9d6b-12d0-4abc-ad03-b23a7cdb1c2a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:09.773785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae320558-0ac5-46ff-8a0e-3b567b87eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:09.775181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320558-0ac5-46ff-8a0e-3b567b87eef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:09.775471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320558-0ac5-46ff-8a0e-3b567b87eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:09.775845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320558-0ac5-46ff-8a0e-3b567b87eef6 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/6ace03f84bc34083bab532ff1e84f09a/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:09.796305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320558-0ac5-46ff-8a0e-3b567b87eef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=6ace03f84bc34083bab532ff1e84f09a, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:09.801308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320558-0ac5-46ff-8a0e-3b567b87eef6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:09.823131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 351/704] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:09 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/6ace03f84bc34083bab532ff1e84f09a/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:10.279153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec21d8-a677-469f-bbf3-d7a5bb7ee5ab None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.279679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec21d8-a677-469f-bbf3-d7a5bb7ee5ab None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.280103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec21d8-a677-469f-bbf3-d7a5bb7ee5ab None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.282028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 354/705] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:10.300939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.301217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.301488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.328989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:10.330227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:10.435005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 352/706] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:10.479355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec21d8-a677-469f-bbf3-d7a5bb7ee5ab None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.503068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec21d8-a677-469f-bbf3-d7a5bb7ee5ab None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.510986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.512078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.512597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.513017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.533770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:10.541531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:10.543179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 355/707] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:10.549895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.564474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3431d-5ad1-436a-8b05-7c315a302150 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.569714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.570529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.570977 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.571360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.572345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:10.572752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:10.574619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:10.590678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 353/708] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:10.597307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.616514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2380a-af3f-4080-934c-66fa37f71cd8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.626905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.628793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.629252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.629706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.648138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:10.650231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:10.671370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:10.672833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 356/709] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:10.679546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.697210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732fd1f-5fd1-4cde-aa6c-37c749c401ab admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.706527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.707350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.707730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.708123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.708961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:10.709360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:10.711095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:10.728443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 354/710] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:10.734032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.748627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae60ab2-3285-4724-aac3-f10a3b0efe4e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.758173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.759198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.759648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.760085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.774877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:10.777158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:10.803356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:29:10.804843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 357/711] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:10.810708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.833127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d0f4-e10a-4e41-9c52-baaf9a89a4f0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.838039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.838773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.839097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.839374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.840259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:10.840568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:10.842510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:10.877790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 355/712] 10.222.0.66 () {56 vars in 1157 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:10.883855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.900304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3dba-ea7c-47ea-b035-4766edb1d212 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.912887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:10.914044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:10.914600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:10.915171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:10.931551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:10.933557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:10.959563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:10.961189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 358/713] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:10.967099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:10.984295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fffb41-8998-4a90-81e4-04170614d17a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:10.999843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:11.000558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:11.000839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:11.001120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:11.001886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:11.002200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:11.005295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:11.026291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 356/714] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:11.031975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:11.042012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93a045-799e-4184-bf5f-be9216fe711b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:11.053676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:11.054540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:11.054860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:11.055119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:11.066806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:11.068830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:11.088901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:11.090518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 359/715] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:11.096181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:11.116248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a686a6-0314-4903-8427-7b7d88dd54e2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:11.131675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:11.132362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:11.132649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:11.132930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:11.133726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:11.134038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:11.135952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba135-b75e-48d9-ba50-22189d7ca9ad admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:11.157568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 357/716] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:11.163558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:11.173790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2634e2-4619-4647-9aad-d7a8d9e1cafb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:11.186497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2f361-a562-45dc-aa80-a9b3f64fe954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:11.187319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f361-a562-45dc-aa80-a9b3f64fe954 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:11.187687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f361-a562-45dc-aa80-a9b3f64fe954 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:11.187925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f361-a562-45dc-aa80-a9b3f64fe954 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/2bd1472455034b3884be9c92d21c591f/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:11.191887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2f361-a562-45dc-aa80-a9b3f64fe954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=2bd1472455034b3884be9c92d21c591f, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:11.194782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2f361-a562-45dc-aa80-a9b3f64fe954 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:11.215513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 360/717] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:11 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/2bd1472455034b3884be9c92d21c591f/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:12.162488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701aeba-8334-42db-86de-5900d1ddacc4 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.163614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701aeba-8334-42db-86de-5900d1ddacc4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.164129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701aeba-8334-42db-86de-5900d1ddacc4 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.166627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 358/718] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:12.172280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.173235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.173733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.203976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:12.206033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:12.211926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7784ea-36d8-48b3-aee6-772b2700feff None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.212554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7784ea-36d8-48b3-aee6-772b2700feff None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.213020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7784ea-36d8-48b3-aee6-772b2700feff None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.215255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 359/719] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:12.220428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.220724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.220986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.259965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:12.261618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:12.322020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 361/720] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:12.350997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 360/721] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:12.368496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.376681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.381821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e624afa-bab4-48ea-b310-87890abd6a9e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.390040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.391284 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.391774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.392254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.393763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.395927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.398857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a572cf-6f04-45e9-91b6-b3964b589a53 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.412579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 08:29:12.415682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.416853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.417343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.417842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] PATH_INFO: `/v3/services/network` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.418706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.420589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.425319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 362/722] 10.222.0.66 () {56 vars in 1151 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:12.432869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.441918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 08:29:12.445052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 361/723] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services/network => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:12.447157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653c92-ca9d-4f3d-a420-6d28f12b8192 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.449316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.460118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.461205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.461690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.462195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.463242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:12.464077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.466173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910b70-fa0d-41da-9e9f-c01592923cea admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.468165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.477401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.478190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 363/724] 10.222.0.66 () {56 vars in 1146 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:12.479123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.479670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.480142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.481096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] RBAC: Adding query filter params (name=network) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:12.481604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.484093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.486503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.498000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece80348-560b-4118-b9b5-63bb29108fa4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.499191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 362/725] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:12.507871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.509181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.510122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.511151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.512637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.513573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:12.515375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.517252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.528646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 364/726] 10.222.0.66 () {56 vars in 1146 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:12.531289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65d7ea-c880-47d8-81b3-d88f2b406f33 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.534519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.542162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.543250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.543882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.545468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.546434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] RBAC: Adding query filter params (type=network) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:12.547745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.550268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.552537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc901a25-eb89-484c-9ee2-3169a04e112d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.563503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.564663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.565784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 363/727] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services?type=network => generated 350 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:12.566303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.566851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.567870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.569370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:12.569370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:29:12.569370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:29:12.570769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.575306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad820-4413-415b-8f11-0ef16f78ac83 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.588554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd54af1-f3ae-4b0b-bc08-4b695b220a77 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.599274 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.601308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.602593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.603154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.604187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.605707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:12.605707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:29:12.605707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:29:12.607207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.619577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 365/728] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:12 2021] POST /identity/v3/endpoints => generated 346 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:29:12.643428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240729ef-f9d9-4394-a451-3b5ae3019205 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.644665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240729ef-f9d9-4394-a451-3b5ae3019205 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.645576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240729ef-f9d9-4394-a451-3b5ae3019205 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.648327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 366/729] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:12.652515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 364/730] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:12 2021] POST /identity/v3/endpoints => generated 327 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:12.657212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.657532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.657780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.681817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:12.683019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:12.703180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 367/731] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:12.730199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.744910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ab9f-e40f-46dd-be2e-670f315eb45a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.749399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.750239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.750524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.750828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.771810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:12.786891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:29:12.789410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 365/732] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:12.795776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.806168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05c712-9752-42ef-a955-19964bc242bd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.810762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.811503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.811788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.812066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.812857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:12.813169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.815007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.826136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 368/733] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:12.832998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.853179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac71af-5887-4e36-9f39-4fdb6a1ec48f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.857681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.858517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.858798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.859101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.877188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.879112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.899265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-951cb8ba-cb7c-4637-82c2-ca12155f0af1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:12.900875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 366/734] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:12.908351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.919048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe7959-fdf7-46d1-a664-32d2058776f8 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.919369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe7959-fdf7-46d1-a664-32d2058776f8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.919737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe7959-fdf7-46d1-a664-32d2058776f8 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.919987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc648b0-4f7f-469e-be27-7a01b060c353 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.922229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 367/735] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:12.929033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.929341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.929578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.929996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.930631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.931320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.932001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.933261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:12.933868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:12.936021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:12.953836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:12.955059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:12.961031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 369/736] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:12.963244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 368/737] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:12.966947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.979210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7ef8a-d61b-4a50-b6b5-0e85e09fd9d1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:12.986011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:12.990729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:12.992415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:12.992852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:12.993449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:12.996235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819796f6-e0f3-4c85-8f3b-7b5acdc9cdfa None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.006544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.006749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.007646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.007926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.008202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.008913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.010255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.010576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.029671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:29:13.031294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 369/738] 10.222.0.66 () {56 vars in 1154 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:13.032681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:29:13.035045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 370/739] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:29:12 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:13.042422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.049705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.052911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907af1-5967-49bb-b2a2-532fd6763358 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.057847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.058661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.059087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.059427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.060268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:13.060573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.061765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e624e-81d1-413e-99f8-45992bf71c3a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.062424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.068218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.069228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.069736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.070218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.071773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:13.072293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.075545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.083149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 371/740] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:13.089213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 370/741] 10.222.0.66 () {56 vars in 1171 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:13.089574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.098950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.103850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad5076-fe8a-4b23-8e3a-b8d76e5ad7e7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.107997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299a26-daa4-4dbe-91a3-901a34d2f261 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.108262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.108956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.109228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.109497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.110224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:13.110515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.112761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.113924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.115040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.115819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.116372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.118724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 372/742] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:13.131951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.133826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.144608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 371/743] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:29:13.152097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.163411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28bb3-3bad-4b15-ba4c-42db22b8d9fa admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.168367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.169561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.170032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.170492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.182667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.185451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.205757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:13.207723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 373/744] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:13.213749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.234236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90016179-c3e2-4e7f-9c0c-4093757cb8f4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.239683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.240709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.241187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.241655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.242585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:13.243140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.244970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.263026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 372/745] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:13.270765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.280859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644bd8-91bc-4477-a57d-c6dc1d471810 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.285461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.286270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.286548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.286817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.294651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.296667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.311360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:13.312270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 374/746] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:13.318789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.329582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ce65-2852-4355-848c-74760def841a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.335302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.335981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.336268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.336548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.337339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:13.337653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.339618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411bde5-3141-46f8-afd8-f7bc809bc677 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.354447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 373/747] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:13.360313 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:13.370698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbee38e-b2f7-4ab2-a752-2995b0b6317f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:13.375112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:13.375967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.376252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.376519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.377882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=6ace03f84bc34083bab532ff1e84f09a) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:13.378323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:13.380209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d6542-e8c4-48e4-a7e4-84443e87627f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:13.386976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 375/748] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:13 2021] GET /identity/v3/role_assignments?user.id=6ace03f84bc34083bab532ff1e84f09a&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:13.953758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88647a6e-edc1-4f5b-847e-365a5da3e0e2 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.954135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88647a6e-edc1-4f5b-847e-365a5da3e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.954330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88647a6e-edc1-4f5b-847e-365a5da3e0e2 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.956673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 374/749] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:13.962333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:13.962626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:13.962900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:13.980778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:13.981942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:13.995021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 376/750] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:13 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:14.013695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88647a6e-edc1-4f5b-847e-365a5da3e0e2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.025675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88647a6e-edc1-4f5b-847e-365a5da3e0e2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.029821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.030598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.030880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.031185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.042718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:14.050099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:14.056693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 375/751] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:14.058189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.067179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc47040-26c1-49a8-8520-fd56ef24ad32 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.071516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.072188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.072473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.072745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.073493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:14.073799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.075433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.089062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 377/752] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:14.090427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.102084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e8e1d-af92-4f6d-87cf-075fef1c9845 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.106359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.107272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.107550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.107860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.119889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.121731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.138329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:14.139867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 376/753] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:14.145726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.154971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d74b-4611-40f5-a0d8-d80b37d5f04f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.159820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.160480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.160762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.161036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.161753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:14.162057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.163700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.180282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 378/754] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:14.181610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.191431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559589a3-bf28-4ee3-b0ef-716e8075cef6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.195774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.196557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.196835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.197105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] PATH_INFO: `/v3/users/swift` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.205539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.207613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.221124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 08:29:14.222604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 377/755] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:14.228354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.248435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb972-4135-4d33-bfdc-728d2b881883 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.253558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.254398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.254840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.255300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.256278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:14.256767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.258830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.282292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 379/756] 10.222.0.66 () {56 vars in 1157 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:14.284097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.293442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83abf9-476f-4082-9b15-aafc604971af admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.297961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.298810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.299789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.300232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.308364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.310281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.324565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 378/757] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:14.326152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.335806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fea63f-113a-49ef-9f45-4c9d8df7ac51 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.340492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.341495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.341970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.342393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.353688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.355867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.374371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:14.379719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 380/758] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:14.382819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.391439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71638f51-9547-42fe-91a6-38329888c88a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.396980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.397803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.398282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.398703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.399665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:14.400122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.401972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.420869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 379/759] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:14.422552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.432681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428757b-f6b4-4498-8c0b-b2663838d8cd admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.437391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.438394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.438819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.439258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.446735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.448990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.463153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:14.469318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 381/760] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:14.471589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.481421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0d388-69a4-46ac-8fc4-91b45be9c619 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.486077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.487144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.487647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.488149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.489100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:14.489616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.491871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e28a-1214-4074-8391-634cfb06a925 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.509737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 380/761] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:14.511448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:14.523164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a97a-e743-4f7c-a797-53ded9bdb2a2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:14.527980 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:14.528892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:14.529392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:14.529870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:14.530999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=2bd1472455034b3884be9c92d21c591f) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:14.531485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:14.534233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c71c-4fdc-4ad2-8ce8-3f04442fb13c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:14.547077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 382/762] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:14 2021] GET /identity/v3/role_assignments?user.id=2bd1472455034b3884be9c92d21c591f&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:15.079414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abbd03-fdc9-46d4-9c91-7eba8586afbf None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.079792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abbd03-fdc9-46d4-9c91-7eba8586afbf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.079968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abbd03-fdc9-46d4-9c91-7eba8586afbf None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.082222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 381/763] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:15.087882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.088163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.088438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.107552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:15.108710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:15.116875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 383/764] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:15 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:15.147713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abbd03-fdc9-46d4-9c91-7eba8586afbf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.165404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abbd03-fdc9-46d4-9c91-7eba8586afbf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.171878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.172789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.173081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.173399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.174739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.177055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.191127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:29:15.192962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 382/765] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:15.199290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.212091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53b03-393e-4714-b4bf-3157101e149b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.216644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.217321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.217603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.217866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.218589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:15.218890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.220517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b932a-b35b-4e08-845c-720fe0ed7294 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.226312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 384/766] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:15.231992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.244281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8b87c-dfd4-4df3-95df-0df2eac06cb3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.252890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.254247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.254557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.255058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.255897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:15.256254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.257997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c941-00ba-4af8-b28d-b50e9cb797ee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.263904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 383/767] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:15.473229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3966df-bde2-484b-8235-8bc0e9893ddf None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.473736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3966df-bde2-484b-8235-8bc0e9893ddf None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.473736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3966df-bde2-484b-8235-8bc0e9893ddf None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.475758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 385/768] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:15.481516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb330-0862-4406-aa8e-760604dd0679 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.481813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb330-0862-4406-aa8e-760604dd0679 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.482094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb330-0862-4406-aa8e-760604dd0679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.500442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ca4bb330-0862-4406-aa8e-760604dd0679 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:15.501576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ca4bb330-0862-4406-aa8e-760604dd0679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:15.510421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 384/769] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:15 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:15.535847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3966df-bde2-484b-8235-8bc0e9893ddf None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.547672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3966df-bde2-484b-8235-8bc0e9893ddf None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.552667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.553425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.553706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.553979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.554760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.555855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:15.555855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:29:15.555855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:29:15.556797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406ea9f-be99-4a84-b4c8-425c8e2146c8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.574524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 386/770] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:15 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:15.713817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc838-21ba-4bbf-9951-5e3e0f969e10 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.714101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc838-21ba-4bbf-9951-5e3e0f969e10 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.714378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc838-21ba-4bbf-9951-5e3e0f969e10 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.716478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 385/771] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:15.726714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.727102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.727483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.747444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:15.748789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:15.769870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 387/772] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:15 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:15.794620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc838-21ba-4bbf-9951-5e3e0f969e10 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.808034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc838-21ba-4bbf-9951-5e3e0f969e10 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.812113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.813009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.813298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.813736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.827153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:15.835521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:29:15.837218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 386/773] 10.222.0.66 () {56 vars in 1142 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:15.845021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.857876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086bc45-c578-4a20-8e3d-17705627145e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.868619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.869311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.869600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.869880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.870707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:15.871101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.872967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.883575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 388/774] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:15.889465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.909280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de530ba1-d2ae-4394-97c0-1db36a92ffb8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.914100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.915268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.915774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.916306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.929842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.932112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.949570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:15.951446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 387/775] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:15.958054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:15.967878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aa24f-41b6-4dfd-91c9-bf782572f58a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:15.973027 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:15.973989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:15.974557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:15.975058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:15.975983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:15.976503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:15.978465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:15.992306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 389/776] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:15.998220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.008509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974da3d-0462-4b9c-9dad-3f3557731534 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.013115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.014221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.014720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.015213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.025270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.027735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.043393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:29:16.045274 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 388/777] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:29:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:16.051950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.061667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2747eb-8c39-4065-b39a-ad340a48327f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.067078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.068003 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.068498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.068973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.070009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:16.070562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.072744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.094065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 390/778] 10.222.0.66 () {56 vars in 1171 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:16.100107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.109919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363e120-584b-4c53-9caf-86408b4feccd admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.114480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.115413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.116028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.116569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.125903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.128543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.138129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 389/779] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:16.144697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.154179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810228-642c-4c63-85cf-1f193d71686a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.159187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.160232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.160708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.161196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.172438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.174802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.193405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:16.195572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 391/780] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:16.201467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.210872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e261b-a6d2-4642-b341-9e044f0b8e14 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.215435 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.216345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.216826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.217320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.218244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:16.218744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.220602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.234402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 390/781] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:16.241292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.251166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498c41-960a-49bf-b720-15e43688e889 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.256041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.256837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.257116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.257389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.264749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.266716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.282058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:16.283623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 392/782] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:16.289374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.299293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be83f-2793-4c1b-9157-6b9dc3bc31ae admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.303753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.304419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.304698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.304965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.305752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:16.306053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.308017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193b2ad-c55d-43f6-85e9-0ce63c87debb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.321744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 391/783] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:16.327731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.338517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138832d-efdb-4c60-8606-557dcf1d49b2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.342885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.343560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.343831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.344095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.344915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] RBAC: Adding query filter params (role.id=6ec67e4e890e4288af8b6cb98e1c761f, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=6ace03f84bc34083bab532ff1e84f09a) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:16.345282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.347200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fa06b-bbbb-481e-9f7f-210c78c292d0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.353487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 393/784] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/role_assignments?user.id=6ace03f84bc34083bab532ff1e84f09a&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=6ec67e4e890e4288af8b6cb98e1c761f => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:16.884203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072cac1-d151-4c51-9fea-93d6f54f3415 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.884482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072cac1-d151-4c51-9fea-93d6f54f3415 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.884760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072cac1-d151-4c51-9fea-93d6f54f3415 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.886864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 392/785] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:16.892688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.894102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.894196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.922209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:16.923430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:16.931622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 394/786] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:16 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:16.956767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072cac1-d151-4c51-9fea-93d6f54f3415 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:16.975182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072cac1-d151-4c51-9fea-93d6f54f3415 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:16.980074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:16.981000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:16.981278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:16.981571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:16.982454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:16.984165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:16.997407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:29:16.998951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 393/787] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:16 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:17.005586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:17.014259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545a3b-df7d-4311-8cdc-f4a1f9b42f8a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:17.019379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:17.020043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:17.020320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:17.020591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:17.021303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:17.021605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:17.023255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75de190-34ae-40b7-85d8-42318fa2405e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:17.028760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 395/788] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:17.035796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:17.049549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44771d-de54-48d3-92cb-362618bb0170 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:17.053970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:17.054640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:17.054944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:17.055219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:17.055927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:17.056229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:17.057835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692778c-baa6-468e-a8d0-25677bba59f9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:17.063145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 394/789] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:17 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:17.535614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f1c2-7174-4b66-9f7b-9a1c339e4b4b None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:17.535961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f1c2-7174-4b66-9f7b-9a1c339e4b4b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:17.536129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f1c2-7174-4b66-9f7b-9a1c339e4b4b None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:17.538148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 396/790] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:17.543873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bde026-0109-4bc5-92bd-21be78bc6218 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:17.544407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bde026-0109-4bc5-92bd-21be78bc6218 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:17.544407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bde026-0109-4bc5-92bd-21be78bc6218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:17.563676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-60bde026-0109-4bc5-92bd-21be78bc6218 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:17.564898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-60bde026-0109-4bc5-92bd-21be78bc6218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:17.572186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 395/791] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:17 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:17.596504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f1c2-7174-4b66-9f7b-9a1c339e4b4b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:17.608664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f1c2-7174-4b66-9f7b-9a1c339e4b4b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:17.613016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae35508-8906-46f1-bdf1-2498e45ed84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:17.613686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae35508-8906-46f1-bdf1-2498e45ed84b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:17.613968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae35508-8906-46f1-bdf1-2498e45ed84b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:17.614247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae35508-8906-46f1-bdf1-2498e45ed84b admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:17.615007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae35508-8906-46f1-bdf1-2498e45ed84b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:17.616635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae35508-8906-46f1-bdf1-2498e45ed84b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:17.643287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 397/792] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:17 2021] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:17.990346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0eae6-b317-46d8-82a1-e70d20bf05d5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:17.991053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0eae6-b317-46d8-82a1-e70d20bf05d5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:17.991601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0eae6-b317-46d8-82a1-e70d20bf05d5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:17.994149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 396/793] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:18.000271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.001297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.001297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.020514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:18.021683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:18.046233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 398/794] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:17 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:18.072192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0eae6-b317-46d8-82a1-e70d20bf05d5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.084953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0eae6-b317-46d8-82a1-e70d20bf05d5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.089538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.090591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.091158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.091673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.092631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.094451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.107423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:29:18.109344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 397/795] 10.222.0.66 () {56 vars in 1154 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:18.116601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.127745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a284d4-518e-44be-a99a-70f420ec6501 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.132259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.132929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.133211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.133486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.134200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:18.134509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.136143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.141708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 399/796] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:18.148234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.158221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b5db1-79af-4d43-9561-b87fdb0af951 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.163732 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.164812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.165329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.165822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.166816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:18.167419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.169450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.176564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 398/797] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:18.182650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.193462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e3764-dad4-462d-adef-45193cb7841f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.198503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.199493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.200102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.200581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.201574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] RBAC: Adding query filter params (interface=public, service_id=66489bab2e014edaa964c8d511b04b2a, region_id=RegionOne) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:18.202086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.203968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf07ac-4bf3-44d4-8b0c-08e3bd640e01 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.210807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 400/798] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/endpoints?service_id=66489bab2e014edaa964c8d511b04b2a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:18.216719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.227429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f07472-705c-4eb1-981e-acf85350ec7b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.232206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ebc3e-d644-40c8-8310-64fdb3e3f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.233146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ebc3e-d644-40c8-8310-64fdb3e3f18a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.233657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ebc3e-d644-40c8-8310-64fdb3e3f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.234198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ebc3e-d644-40c8-8310-64fdb3e3f18a admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.235103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ebc3e-d644-40c8-8310-64fdb3e3f18a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.238332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ebc3e-d644-40c8-8310-64fdb3e3f18a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.247185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 399/799] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:29:18.628173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56580b3b-f8bb-4613-9bf6-61702a848d7e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.628555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56580b3b-f8bb-4613-9bf6-61702a848d7e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.628793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56580b3b-f8bb-4613-9bf6-61702a848d7e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.630841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 401/800] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:18.636471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.636941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.637015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.654559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:18.655743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:18.663736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 400/801] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:18 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:18.687448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56580b3b-f8bb-4613-9bf6-61702a848d7e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.699401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56580b3b-f8bb-4613-9bf6-61702a848d7e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.703489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.704285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.704561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.704828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.715737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:18.723481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:29:18.724923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 402/802] 10.222.0.66 () {56 vars in 1142 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:18.730721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.739053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccf5c-3882-4338-8b2b-707d5a647dcf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.743250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.743905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.744182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.744452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.745188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:18.745493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.747104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.755876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 401/803] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:18.761641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.772660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd20a-c150-4c6c-a422-44440e31802d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.777076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.777852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.778189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.778458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.789662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.791529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.808868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:18.810361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 403/804] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:18.817142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.826309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061f75-dd97-4ed8-a03d-136021ef27bc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.830679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.831372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.831650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.831923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.832634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:18.832936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.834590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.847558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 402/805] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:18.855005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.864800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4501f-1e35-4ea6-a117-11e56df04177 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.869076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.869965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.870248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.870520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.878779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.880861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.896182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:29:18.897699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 404/806] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:18.903803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.913961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cf3d3-257d-4459-8cc6-0895efc109a6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.919679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.920343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.920622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.920894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.921725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:18.922030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.924457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:18.950358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 403/807] 10.222.0.66 () {56 vars in 1171 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:18.957406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:18.969451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac61aa3-e6d8-4ad0-88ac-0c08ab3f7dfc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:18.976258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:18.977380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:18.977841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:18.978392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:18.990787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:18.993083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:19.013096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:19.015325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 405/808] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:19.022168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:19.031819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb42d6-507d-4f5e-8b79-4da5488e9fc6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:19.036790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:19.037725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.038211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.038708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.039647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:19.040244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:19.042036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:19.055983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 404/809] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:19.061993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:19.072678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe553c5-bcfa-4055-86a5-69e46f387d35 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:19.077413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:19.078428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.078948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.079456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.087626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:19.089895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:19.104943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:19.106719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 406/810] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:19.113128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:19.122952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b93113-ea84-40f5-bf10-b2f7bb91608c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:19.128937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:19.129856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.130343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.130843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.131825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:19.132310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:19.134388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f17f-814e-443c-9b07-c8f9aa360893 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:19.148879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 405/811] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:19.155164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:19.166336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf9ad-f11a-4baf-b49b-990684ed1545 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:19.171066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a8005-12dc-4631-890e-5ac75d66c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:19.172235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8005-12dc-4631-890e-5ac75d66c1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.172722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8005-12dc-4631-890e-5ac75d66c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.173172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8005-12dc-4631-890e-5ac75d66c1e2 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/6ace03f84bc34083bab532ff1e84f09a/roles/6ec67e4e890e4288af8b6cb98e1c761f` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.175956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8005-12dc-4631-890e-5ac75d66c1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=6ace03f84bc34083bab532ff1e84f09a, role_id=6ec67e4e890e4288af8b6cb98e1c761f)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:19.178887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8005-12dc-4631-890e-5ac75d66c1e2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:19.195954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 407/812] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:19 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/6ace03f84bc34083bab532ff1e84f09a/roles/6ec67e4e890e4288af8b6cb98e1c761f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:19.554891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1274-6c16-4b10-a067-8ae50dd990e0 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.555372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1274-6c16-4b10-a067-8ae50dd990e0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.555753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c1274-6c16-4b10-a067-8ae50dd990e0 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.557891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 406/813] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:19.563531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78359f-c352-4e53-9a6c-075cfde97de3 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.563934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78359f-c352-4e53-9a6c-075cfde97de3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.564345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78359f-c352-4e53-9a6c-075cfde97de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.584268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1d78359f-c352-4e53-9a6c-075cfde97de3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:19.585691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1d78359f-c352-4e53-9a6c-075cfde97de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:19.652543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 408/814] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:19 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:19.677151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c1274-6c16-4b10-a067-8ae50dd990e0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:19.689202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c1274-6c16-4b10-a067-8ae50dd990e0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:19.693800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358102-c13d-4cbd-aa2a-fdae765f720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:19.694455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358102-c13d-4cbd-aa2a-fdae765f720a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:19.694733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358102-c13d-4cbd-aa2a-fdae765f720a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:19.695045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358102-c13d-4cbd-aa2a-fdae765f720a admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:19.695831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28358102-c13d-4cbd-aa2a-fdae765f720a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:19.697493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28358102-c13d-4cbd-aa2a-fdae765f720a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:19.713869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 407/815] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:19 2021] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:29:20.000984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe47d-2879-4f4f-9bee-c7cd67c934b5 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.001156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe47d-2879-4f4f-9bee-c7cd67c934b5 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.001442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe47d-2879-4f4f-9bee-c7cd67c934b5 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.004489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 409/816] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:20.010094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.010387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.010668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.029366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:20.030528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:20.051059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 408/817] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:20 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:20.071987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe47d-2879-4f4f-9bee-c7cd67c934b5 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.084361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe47d-2879-4f4f-9bee-c7cd67c934b5 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.088603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.089406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.089689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.089967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.090690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.092403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.104718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:29:20.112035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 410/818] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:20.112427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.120878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fee3b-ed1e-4191-9445-529b494034e5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.125268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.126003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.126288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.126624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.127972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:20.128287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.129903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.139024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 409/819] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:20.141311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.150886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e7ca-3144-4668-9ee9-20f78943ff77 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.155426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.156136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.156418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.156693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.157516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:20.157829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.160015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.170244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 411/820] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:20.171622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.181345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1ae94-2e68-449c-be21-f269ca69e2e1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.185798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.186510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.186797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.187102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.187947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] RBAC: Adding query filter params (interface=public, service_id=db7fc16bfe13412297e88deb5e2768be, region_id=RegionOne) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:20.188313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.190701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127419-9f67-4a5f-b2c1-d2637a292c95 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.201178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 410/821] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/endpoints?service_id=db7fc16bfe13412297e88deb5e2768be&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:20.202526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.212418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa6f5-1561-410c-9292-38ee900bf260 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.216902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7032-f89e-4c4a-99aa-a0d62737a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.217616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7032-f89e-4c4a-99aa-a0d62737a070 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.217902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7032-f89e-4c4a-99aa-a0d62737a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.218182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7032-f89e-4c4a-99aa-a0d62737a070 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.218993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c7032-f89e-4c4a-99aa-a0d62737a070 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.220663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c7032-f89e-4c4a-99aa-a0d62737a070 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.231013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 412/822] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:29:20.502327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4fef-e795-446c-b02f-2a6a69cc02f9 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.502710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4fef-e795-446c-b02f-2a6a69cc02f9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.503108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4fef-e795-446c-b02f-2a6a69cc02f9 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.505114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 411/823] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:20.510550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.510836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.511140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.530776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:20.531977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:20.540398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 413/824] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:20 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:20.564535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4fef-e795-446c-b02f-2a6a69cc02f9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.576716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4fef-e795-446c-b02f-2a6a69cc02f9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.582118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.583238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.583727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.584226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.585130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.586968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.599262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 08:29:20.601158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 412/825] 10.222.0.66 () {56 vars in 1154 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:20.607520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.616360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a01668-1ce1-4c66-99f6-b6ad22d23a40 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.621128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.622074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.622558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.623120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.624029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:20.624535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.626400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.632801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 414/826] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:20.638850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.649342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0c1a6-3ad1-4bf9-8fc3-4a574a22afdf admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.653901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.654789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.655408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.655904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.656827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:20.657381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.660138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71405-2fb5-4b04-916f-548126f3a11d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.665900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 413/827] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:20.671792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:20.682282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362186e7-f691-43e2-a664-de5172f71482 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:20.686975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a384a0-7ebc-4e4c-b9e4-7caeb4f59cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:20.687926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384a0-7ebc-4e4c-b9e4-7caeb4f59cdf admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:20.688411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384a0-7ebc-4e4c-b9e4-7caeb4f59cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:20.688904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384a0-7ebc-4e4c-b9e4-7caeb4f59cdf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:20.689959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a384a0-7ebc-4e4c-b9e4-7caeb4f59cdf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:20.691825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a384a0-7ebc-4e4c-b9e4-7caeb4f59cdf admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:20.712885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 415/828] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:20 2021] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:21.512671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611eab-2bec-41c5-8761-d70a365550c5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.513204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611eab-2bec-41c5-8761-d70a365550c5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.513204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611eab-2bec-41c5-8761-d70a365550c5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.515164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 414/829] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:21.522120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.522606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.522698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.540440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:21.541597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:21.563296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 416/830] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:21 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:21.585326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a611eab-2bec-41c5-8761-d70a365550c5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.598082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a611eab-2bec-41c5-8761-d70a365550c5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.602263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.603095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.603379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.603653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.616769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:21.624099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:29:21.625663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 415/831] 10.222.0.66 () {56 vars in 1142 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:21.632322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.640857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ced0f-ca1f-4e0d-92f9-8b86ef68e83d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.645995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.646669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.646981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.647260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.648019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:21.648322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.649935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.659846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 417/832] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:21.665532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.676195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ab5b-f97c-458b-a75d-2b48cc417fc6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.680643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.681443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.681724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.681996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.693891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.695798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.714844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:21.716473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 416/833] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:21.722579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.732190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249a28e-deb2-4ba3-9432-87b00e934f90 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.736815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.737528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.737808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.738080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.738812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:21.739157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.740773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.753802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 418/834] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:21.759401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.770139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fc0a3-be33-4198-b511-00ae638deaa1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.775210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.776016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.776296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.776565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.785377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.787454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.802696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 08:29:21.804225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 417/835] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:21.810693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.827204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa6ea-8d35-4ecd-97ee-37a490ce21e1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.835268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.836359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.836872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.837377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.839059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:21.839529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.843251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.877116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 419/836] 10.222.0.66 () {56 vars in 1171 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:21.882609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.896305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041852ed-3edb-42b6-b4cf-2da74a9bf491 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.903278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.904419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.904922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.905418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.914454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.916272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.926209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 418/837] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:21.932002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:21.942375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f556-b739-4895-b607-015928944113 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:21.946942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:21.947742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:21.948025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:21.948301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:21.960859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:21.963550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:21.984991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:21.987361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 420/838] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:21.993196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.003189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bebe5-5986-4472-b0e2-fbf41ae051a0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.008109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.009146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.009634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.010111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.011095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.011625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.013515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f349179-fe9e-4104-a566-d30e1644875d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.026876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 419/839] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:22.032951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.036740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272bb2-9fb2-4cd3-925c-7ef3f7ebe7fd None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.037354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272bb2-9fb2-4cd3-925c-7ef3f7ebe7fd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.037859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272bb2-9fb2-4cd3-925c-7ef3f7ebe7fd None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.040311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 420/840] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:22 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:22.046595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.047197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.047725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.050223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4072f-1db0-40c2-8013-3f1c7575a4ce admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.055436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.056744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.056744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.057129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.065417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.067568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.070689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:22.072163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:22.086960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:22.086960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 421/842] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:22.087358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 421/842] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:22 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:22.090280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.101124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517205b-a0c0-41e1-8d18-89fd79caa63c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.105735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.106543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.107097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.107341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.108268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.108641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.108834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.110722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.118962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec80a5f-c22a-496b-87dc-674303a2e2a4 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.123733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.124852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.125331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.125797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.126635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.127458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 422/843] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:22.128796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.133656 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.143375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b069e2-0db5-4498-a72a-f0b1f8f2fdea admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.148300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.148958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.149238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.149515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.150333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] RBAC: Adding query filter params (role.id=6ec67e4e890e4288af8b6cb98e1c761f, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=6ace03f84bc34083bab532ff1e84f09a) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.150641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.152531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.157187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:29:22.159970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 423/844] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/role_assignments?user.id=6ace03f84bc34083bab532ff1e84f09a&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=6ec67e4e890e4288af8b6cb98e1c761f => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:22.167151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 422/845] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:22.172346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.186275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a8b92-2510-42af-a4ef-64284f4c8011 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.192762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.194095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.194704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.195311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.196419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.196957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.198989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.208258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 424/846] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:22.218898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.237110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3059a-7649-43e6-9e9e-aa7f23b4898d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.246979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.246979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.247282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.247701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.249108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.249675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.253519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.263509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 423/847] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:22.275000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.291683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647d37-f6fd-4606-86f1-e192f9defc07 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.299567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.300711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.301210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.301709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.303386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] RBAC: Adding query filter params (interface=public, service_id=afea8fe1111940dca095e99f69a855fa, region_id=RegionOne) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.303969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.307282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d00e0c-e4ee-4895-930f-7735b4537f3a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.318431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 425/848] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/endpoints?service_id=afea8fe1111940dca095e99f69a855fa&interface=public®ion_id=RegionOne => generated 194 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:22.328585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.346448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016d82f-fe9f-42b9-bded-cebd651036f9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.353851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8add79-be18-423e-b8c2-8155da5a17fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.355034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8add79-be18-423e-b8c2-8155da5a17fa admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.355530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8add79-be18-423e-b8c2-8155da5a17fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.356027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8add79-be18-423e-b8c2-8155da5a17fa admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.357344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8add79-be18-423e-b8c2-8155da5a17fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.360609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8add79-be18-423e-b8c2-8155da5a17fa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.373711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 424/849] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services => generated 1497 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:29:22.531887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef928-289e-40e0-97d9-28091251e59b None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.531887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef928-289e-40e0-97d9-28091251e59b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.531887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef928-289e-40e0-97d9-28091251e59b None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.532996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 426/850] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:22.539230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.539777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.539777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.565705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:22.567577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:22.581858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 425/851] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:22 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:22.606771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef928-289e-40e0-97d9-28091251e59b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.620782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef928-289e-40e0-97d9-28091251e59b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.625642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.626793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.627926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.628568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.629480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.631386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.644545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 08:29:22.646519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 427/852] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:22.652987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.662848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbffc85-fbbc-49fe-978d-ebe8a4179038 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.668449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.669189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.669467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.669743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.670615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.670963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.672756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.680328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 426/853] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:22.686433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.699176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58395ca-8fb5-4774-92e5-7a838bea7713 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.704732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.706673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.707252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.707783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.708977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:22.709502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.711639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a0f69-6307-4a83-935a-efc3bb6d207e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.718378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 428/854] 10.222.0.66 () {56 vars in 1136 bytes} [Tue Jul 13 08:29:22 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:22.725491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:22.736496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f2f1-1b30-4b45-9cc8-0bc8b317ee3b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:22.741921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f4e4-edc0-4c72-9c86-aba25de34502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:22.743142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f4e4-edc0-4c72-9c86-aba25de34502 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:22.743725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f4e4-edc0-4c72-9c86-aba25de34502 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:22.744223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f4e4-edc0-4c72-9c86-aba25de34502 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:22.745247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f4e4-edc0-4c72-9c86-aba25de34502 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:22.747268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f4e4-edc0-4c72-9c86-aba25de34502 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:22.774581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 427/855] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:22 2021] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:23.045395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26201b-d6fd-4242-bb28-d0bfa6399032 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:23.045795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26201b-d6fd-4242-bb28-d0bfa6399032 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:23.046031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26201b-d6fd-4242-bb28-d0bfa6399032 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:23.048004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 429/856] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:23.054352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:23.054752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:23.055088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:23.073943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:23.075161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:23.093635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 428/857] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:23 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:23.117913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26201b-d6fd-4242-bb28-d0bfa6399032 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:23.130966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26201b-d6fd-4242-bb28-d0bfa6399032 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:23.135734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:23.136778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:23.137210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:23.137640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:23.138512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:23.140327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:23.153242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:29:23.154835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 430/858] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:23 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:23.161300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:23.170449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24a96-53be-4a5e-b20c-bb2ea79d7987 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:23.175905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:23.176866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:23.177317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:23.177774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:23.178687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:23.179310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:23.181156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0968ed-57d1-4cdb-9a0a-9b64f80e11b8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:23.191070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 429/859] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:23 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:23.194502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:23.205857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ccad0-cd72-4d0d-9bae-6e8613c6d5f4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:23.210954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:23.211800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:23.212457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:23.212880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:23.213744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:23.214216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:23.216184 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85d141-764c-4efe-86d7-2242537478f7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:23.226949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 431/860] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:23 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:24.492009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30190c3d-218d-4fa5-953f-6be15e72f1ff None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:24.492528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30190c3d-218d-4fa5-953f-6be15e72f1ff None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:24.492528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30190c3d-218d-4fa5-953f-6be15e72f1ff None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:24.494646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 430/861] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:24.501064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448631-786e-449b-b539-838b78e54a4e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:24.501609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448631-786e-449b-b539-838b78e54a4e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:24.502368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448631-786e-449b-b539-838b78e54a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:24.520917 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6b448631-786e-449b-b539-838b78e54a4e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:24.522088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6b448631-786e-449b-b539-838b78e54a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:24.529748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 432/862] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:24 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:24.553099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30190c3d-218d-4fa5-953f-6be15e72f1ff None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:24.565972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30190c3d-218d-4fa5-953f-6be15e72f1ff None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:24.570409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:24.571252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:24.571536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:24.571812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] PATH_INFO: `/v3/services/image` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:24.572471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:24.574086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:24.586117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:29:24.587680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 431/863] 10.222.0.66 () {56 vars in 1127 bytes} [Tue Jul 13 08:29:24 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:24.593688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448631-786e-449b-b539-838b78e54a4e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:24.602837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448631-786e-449b-b539-838b78e54a4e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:24.607271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:24.607938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:24.608220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:24.608497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:24.609212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] RBAC: Adding query filter params (name=image) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:24.609519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:24.611611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e8218-5e29-4b92-b03b-5072dde1ba36 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:24.617492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 433/864] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:24 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:24.623278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:24.633857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fc1c-a073-4a21-90ad-60d6e0bf7096 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:24.638303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:24.638996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:24.639282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:24.639554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:24.640258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] RBAC: Adding query filter params (type=image) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:24.640564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:24.642157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c84c5-0821-4aa6-9ef8-90355beba822 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:24.647944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 432/865] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:24 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:25.292920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1c044-1487-4da1-aa16-417c4c98f6a4 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.293546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1c044-1487-4da1-aa16-417c4c98f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.294054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1c044-1487-4da1-aa16-417c4c98f6a4 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.297949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 434/866] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:25 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:25.308009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.308514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.309022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.312180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ea012-37ec-488e-a50f-a0323c1c157d None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.312738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ea012-37ec-488e-a50f-a0323c1c157d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.313250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ea012-37ec-488e-a50f-a0323c1c157d None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.317602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 435/867] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:25 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:25.328162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.328853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.329474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.338188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:25.339668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:25.351301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 433/868] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:25 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:25.367672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:25.369903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:25.380742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 436/869] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:25 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:25.384486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.395815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea4992-2f71-441a-a1c9-d2d3839e6f4a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.400875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.401773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.402057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.402432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.403554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.405275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.411431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.420036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:29:25.421574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 434/870] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:25.422061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c8f1a-3195-4d69-bb40-710cd8ddf8db None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.428393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.430239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.431192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.431675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.432090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.433351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.436139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.438044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f525eb5-096e-4dda-bb08-7aeeb7531a25 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.438568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.common [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 08:29:25.443885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.444686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.444973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.445250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.446247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:25.446559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.448658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.455585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 435/871] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:25.462042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.471632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.sql.core [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 08:29:25.471632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 08:29:25.471632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [parameters: {'id': '54af3fb02f2447e39996092ff923ed85', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 08:29:25.471632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: (Background on this error at: http://sqlalche.me/e/14/gkpj) {{(pid=72637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:531}} Jul 13 08:29:25.472434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e35b6-8e0e-40e7-b6b1-07438747a35c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.477354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.478044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.478393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.478677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.479458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:25.479767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.481447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.483259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 54af3fb02f2447e39996092ff923ed85.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 54af3fb02f2447e39996092ff923ed85. Jul 13 08:29:25.493732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 437/873] 10.222.0.66 () {60 vars in 1162 bytes} [Tue Jul 13 08:29:25 2021] POST /identity/v3/projects => generated 262 bytes in 78 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:25.494008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 436/873] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:25.495384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.497398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.515473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9a27-8ff0-4d09-bb29-b803752de25b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.519502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ae906-8469-412a-8a7a-d32343a98eba admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.525017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.525921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b5590-8e8b-4938-920e-70ddfee6d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.526130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.526130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.526482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.526711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5590-8e8b-4938-920e-70ddfee6d0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.527015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5590-8e8b-4938-920e-70ddfee6d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.527657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5590-8e8b-4938-920e-70ddfee6d0b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.530147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5590-8e8b-4938-920e-70ddfee6d0b6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.535827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.536086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5590-8e8b-4938-920e-70ddfee6d0b6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.537782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.552733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-2ed4e02a-b192-43f9-a580-53371ad980b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:25.554144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 437/874] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:25.556537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e091b-c34f-4c4b-8ce0-92f8c54cc078 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.556833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e091b-c34f-4c4b-8ce0-92f8c54cc078 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.557107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e091b-c34f-4c4b-8ce0-92f8c54cc078 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.559659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 438/875] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:25.564964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e091b-c34f-4c4b-8ce0-92f8c54cc078 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.569006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 438/876] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:25 2021] POST /identity/v3/endpoints => generated 349 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:25.570273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.570588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.570872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.596623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:25.598506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:25.598675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e091b-c34f-4c4b-8ce0-92f8c54cc078 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.605414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.606647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.606814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 439/877] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:25 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:25.607951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.609037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.613351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:25.613912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.617813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd4c4b-4f46-45f1-a303-0415e510e275 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.632456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:25.641951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7740c71-b18f-462c-be56-7e2a4e3b3600 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:25.647962 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a14104-4492-4246-b57a-935856517535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:25.648658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a14104-4492-4246-b57a-935856517535 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:25.648942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a14104-4492-4246-b57a-935856517535 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:25.649221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a14104-4492-4246-b57a-935856517535 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:25.649984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a14104-4492-4246-b57a-935856517535 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:25.651391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 439/878] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:25 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:25.651837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a14104-4492-4246-b57a-935856517535 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:25.683192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 440/879] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:25 2021] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:27.015471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2373ca-a392-47e1-809f-aa1ad854d8c2 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:27.016176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2373ca-a392-47e1-809f-aa1ad854d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:27.016396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2373ca-a392-47e1-809f-aa1ad854d8c2 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:27.020402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 440/880] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:27.026480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485c12-def9-4929-a2e1-ea7c27fa3f00 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:27.027128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485c12-def9-4929-a2e1-ea7c27fa3f00 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:27.027128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45485c12-def9-4929-a2e1-ea7c27fa3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:27.046657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-45485c12-def9-4929-a2e1-ea7c27fa3f00 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:27.047941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-45485c12-def9-4929-a2e1-ea7c27fa3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:27.069285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 441/881] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:27 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:27.094264 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2373ca-a392-47e1-809f-aa1ad854d8c2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:27.107843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2373ca-a392-47e1-809f-aa1ad854d8c2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:27.113573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80096-b618-4d44-bed8-f09fa0fb5aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:27.114248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80096-b618-4d44-bed8-f09fa0fb5aca admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:27.114533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80096-b618-4d44-bed8-f09fa0fb5aca admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:27.114809 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80096-b618-4d44-bed8-f09fa0fb5aca admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:27.115731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e80096-b618-4d44-bed8-f09fa0fb5aca admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:27.117402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e80096-b618-4d44-bed8-f09fa0fb5aca admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:27.142767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 441/882] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:27 2021] POST /identity/v3/services => generated 242 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:27.907496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da328-1050-4d18-89c2-6918bde3224e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:27.907979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da328-1050-4d18-89c2-6918bde3224e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:27.908661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da328-1050-4d18-89c2-6918bde3224e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:27.911595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 442/883] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:27.917445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab788-53af-4f65-82e9-8e0924b0f2f5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:27.917814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab788-53af-4f65-82e9-8e0924b0f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:27.918052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ab788-53af-4f65-82e9-8e0924b0f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:27.937471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-cb7ab788-53af-4f65-82e9-8e0924b0f2f5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:27.938813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cb7ab788-53af-4f65-82e9-8e0924b0f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:27.958401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 442/884] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:27.983977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da328-1050-4d18-89c2-6918bde3224e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:27.998319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da328-1050-4d18-89c2-6918bde3224e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.003592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.004583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.004888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.005154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.005854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.007520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.020537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:29:28.022113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 443/885] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:28.028052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a86a96-ef5a-4276-b102-6d497e190c34 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.028547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a86a96-ef5a-4276-b102-6d497e190c34 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.028547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a86a96-ef5a-4276-b102-6d497e190c34 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.029299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.030894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 443/886] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:28.041166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24709a72-5792-469c-b69c-157be8d45600 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.041695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24709a72-5792-469c-b69c-157be8d45600 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.041836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44210-52bc-411e-bf4b-b73e72739338 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.042387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24709a72-5792-469c-b69c-157be8d45600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.046461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.047430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.047713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.048104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.049368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.049672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.052702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.059052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 444/887] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:28.063951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-24709a72-5792-469c-b69c-157be8d45600 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:28.065964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.066195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-24709a72-5792-469c-b69c-157be8d45600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:28.079092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 444/888] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:28 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:28.082222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244135d4-0fec-49a3-b8cf-e5545838cfb1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.086658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.087358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.087634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.087903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.088619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.088922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.090526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.097119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 445/889] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:28.103635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24709a72-5792-469c-b69c-157be8d45600 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.114190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24709a72-5792-469c-b69c-157be8d45600 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.118154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.119946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.120841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.121309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.121762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.122781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] RBAC: Adding query filter params (interface=admin, service_id=afea8fe1111940dca095e99f69a855fa, region_id=RegionOne) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.123338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.125312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.136826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cf9ed-ad7c-4786-84d9-9cbdf38da686 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.137249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 445/890] 10.222.0.66 () {56 vars in 1271 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/endpoints?service_id=afea8fe1111940dca095e99f69a855fa&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:28.138999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.141618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.142867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.143764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.144306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.145580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.149053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.150873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02feba6-ef94-42be-8d90-678a8fa407ab admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.155774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.156758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.157300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.157818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.159486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.161329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.169540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 446/891] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:29:28.177167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.sql.core [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 08:29:28.177167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 08:29:28.177167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [parameters: {'user_id': '06b9269513e54498854f3ea516efbdf5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 08:29:28.177167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: (Background on this error at: http://sqlalche.me/e/14/gkpj) {{(pid=72637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:531}} Jul 13 08:29:28.187492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-419d7142-301e-4490-8baa-18da63d15dc5 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 08:29:28.195432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 446/892] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:29:28 2021] POST /identity/v3/users => generated 160 bytes in 78 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:28.201164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.219457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf86e8-b9c4-4401-91f0-9fb224343286 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.226718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.228030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.228503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.229022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.242690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.246499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.250441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ba0f3-9390-4f62-9162-a9a10859ebc0 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.250800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ba0f3-9390-4f62-9162-a9a10859ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.252209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ba0f3-9390-4f62-9162-a9a10859ebc0 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.263117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 447/893] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:28 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:29:28.264624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.264911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.265181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.265406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 08:29:28.267447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 447/894] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:28.277015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.294232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc9f24-21a4-4d03-aa2b-5312c02a507f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.298271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:28.301030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:28.301624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.302744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.303387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.303910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.305290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.305868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.309169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.317026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 448/895] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:28 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:28.357323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.364532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 448/896] 10.222.0.66 () {56 vars in 1123 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:28.370239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4ff7f-c36f-472f-a34a-22fd1da10a69 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.375961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.378889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.378889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.378889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] PATH_INFO: `/v3/services/compute` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.379419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.381832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.394562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:29:28.396241 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 449/897] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:28.402713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.416520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911387-85cf-4348-90fa-121455b95449 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.421846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.422611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.422854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.423117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.424054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.424387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.426053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.432342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 449/898] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:28.438234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.448519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815376-e998-4124-81cc-9fcd0d9511ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.453451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.454128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.454407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.454853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.456145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.456519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.458310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.464663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 450/899] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:28.470868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.481127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd185d-1936-4443-b708-5a5665cb66e3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.485756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.487183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.487463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.487794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.488607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] RBAC: Adding query filter params (interface=public, service_id=fd68a6bdf0f244a1adf9b55ce2fa19a6, region_id=RegionOne) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:28.488920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.490624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a8f89-0b8c-4271-aa1f-5bb62e527877 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.497047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 450/900] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/endpoints?service_id=fd68a6bdf0f244a1adf9b55ce2fa19a6&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:28.503510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:28.513837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817322f3-4caa-41c9-88b8-00aa7c9a9393 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:28.519298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74fc7-db5e-4111-8c3b-e3dd605e9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:28.520042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74fc7-db5e-4111-8c3b-e3dd605e9d22 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:28.520323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74fc7-db5e-4111-8c3b-e3dd605e9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:28.520651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74fc7-db5e-4111-8c3b-e3dd605e9d22 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:28.521404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74fc7-db5e-4111-8c3b-e3dd605e9d22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:28.523186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74fc7-db5e-4111-8c3b-e3dd605e9d22 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:28.535483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 451/901] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:28 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:29:29.443790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae368f-04c2-4f6c-9bc1-766acdc29dab None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.444556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae368f-04c2-4f6c-9bc1-766acdc29dab None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.444556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae368f-04c2-4f6c-9bc1-766acdc29dab None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.446173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 451/902] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:29.452486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.453167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.453167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.473442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:29.474645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:29.482732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 452/903] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:29 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:29.508797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae368f-04c2-4f6c-9bc1-766acdc29dab None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:29.522231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae368f-04c2-4f6c-9bc1-766acdc29dab None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:29.526603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:29.527449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.527730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.528005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] PATH_INFO: `/v3/services/image` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.528667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:29.530298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:29.542020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:29:29.543566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 452/904] 10.222.0.66 () {56 vars in 1127 bytes} [Tue Jul 13 08:29:29 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:29.550049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:29.558726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ede6d-5217-4724-89e5-d1626da00019 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:29.563402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:29.565007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.565007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.565290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.565816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] RBAC: Adding query filter params (name=image) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:29.566135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:29.567853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:29.573930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 453/905] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:29.580328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:29.589972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74f797-30b0-4d52-95c4-f4d684cec927 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:29.594573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:29.595298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.596404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.596404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.597409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] RBAC: Adding query filter params (type=image) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:29.597630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:29.599111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:29.605019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 453/906] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:29.611264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:29.620633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531f642-3680-497e-9d6f-60979073cd2d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:29.625224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:29.625963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.626341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.627359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.628699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] RBAC: Adding query filter params (interface=public, service_id=a2c8d5fe173449f1990f39e4d0e9eb5f, region_id=RegionOne) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:29.629077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:29.630704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11214d-36b1-466e-aa92-786c55fff8c2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:29.637300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 454/907] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:29:29 2021] GET /identity/v3/endpoints?service_id=a2c8d5fe173449f1990f39e4d0e9eb5f&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:29.644043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:29.653480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd0dd-62a3-4aec-9334-62bc3b3e22dd admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:29.658500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffede45-104c-41aa-9fa9-818746447a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:29.659212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffede45-104c-41aa-9fa9-818746447a6c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:29.659493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffede45-104c-41aa-9fa9-818746447a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:29.659757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffede45-104c-41aa-9fa9-818746447a6c admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:29.660432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffede45-104c-41aa-9fa9-818746447a6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:29.662044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffede45-104c-41aa-9fa9-818746447a6c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:29.669742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 454/908] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:29:29 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:29:30.552746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166ead-e663-4f71-89b8-5a4bdb191390 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.553344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166ead-e663-4f71-89b8-5a4bdb191390 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.553344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166ead-e663-4f71-89b8-5a4bdb191390 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.555368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 455/909] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:30.560916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.561592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.561592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.585337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:30.586495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:30.594066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 455/910] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:30 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:30.619221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6166ead-e663-4f71-89b8-5a4bdb191390 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.631133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6166ead-e663-4f71-89b8-5a4bdb191390 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.635155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.635956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.636230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.636501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.637145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.638739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.650580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 08:29:30.653269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 456/911] 10.222.0.66 () {56 vars in 1148 bytes} [Tue Jul 13 08:29:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:30.658636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.668022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1a4bc-ddd4-40e8-a06f-6441c52664a5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.672389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.673058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.673336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.674163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.674869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:30.675209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.676797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.682116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 456/912] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:30.688821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.698317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb626c5-aa69-412c-bd30-97c097cc26c0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.703148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.703839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.704119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.704472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.705836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:30.706066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.707790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253efbc2-81d1-4041-8fca-e185fddae4cf admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.714332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 457/913] 10.222.0.66 () {56 vars in 1144 bytes} [Tue Jul 13 08:29:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:30.721001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.731211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ec8d-398a-42ce-9838-534d7ce5cd0c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.736570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.737339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.737699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.738049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.738880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.740531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.763800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621084dc-ee04-4520-ad1c-bc3dbcd08ef4 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.764237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621084dc-ee04-4520-ad1c-bc3dbcd08ef4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.764403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621084dc-ee04-4520-ad1c-bc3dbcd08ef4 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.766380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 458/914] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:29:30.775066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 457/915] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:30 2021] POST /identity/v3/endpoints => generated 325 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:30.775373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.775373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.775373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.793114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:30.794311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:30.812990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 459/916] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:30 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:30.837848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.848427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191feff0-7636-428f-b436-f7f2063794cd admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.853094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.853917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.854200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.854472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.855190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.856884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.871504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 08:29:30.872789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 458/917] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:30.879909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.891326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbf966-963c-4ff0-b8cb-54606822501a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.899976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.901262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.901857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.902460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.904014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:30.904578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.908624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.919127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 460/918] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:30.930495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.948497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165a83a-4596-4158-876c-ffe121e1429d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.953833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.954738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.954849 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.955148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.955897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:30.956200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.957850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25f70-9392-4e1b-a347-e847ed230391 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:30.963933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 459/919] 10.222.0.66 () {56 vars in 1134 bytes} [Tue Jul 13 08:29:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:30.969858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:30.980245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54d09-7968-49fd-baea-1fe0e02701d4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:30.985464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b56484-9d9a-4726-8039-67148ddf5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:30.986776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56484-9d9a-4726-8039-67148ddf5b8a admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:30.987101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56484-9d9a-4726-8039-67148ddf5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:30.987478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b56484-9d9a-4726-8039-67148ddf5b8a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:30.988850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b56484-9d9a-4726-8039-67148ddf5b8a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:30.990719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b56484-9d9a-4726-8039-67148ddf5b8a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:31.021542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 461/920] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:30 2021] POST /identity/v3/endpoints => generated 334 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:31.936301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b38a8a-1b9a-4f78-8565-ceeb40b6f78d None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:31.936853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b38a8a-1b9a-4f78-8565-ceeb40b6f78d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:31.936853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b38a8a-1b9a-4f78-8565-ceeb40b6f78d None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:31.939575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 460/921] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:29:31.945034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:31.945518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:31.945617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:31.964435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:31.965599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:31.983466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 462/922] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:31 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:32.007295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b38a8a-1b9a-4f78-8565-ceeb40b6f78d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:32.020722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b38a8a-1b9a-4f78-8565-ceeb40b6f78d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:32.025357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:32.026163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:32.026441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:32.026713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] PATH_INFO: `/v3/services/image` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:32.027416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:32.029116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:32.041075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 08:29:32.042720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 461/923] 10.222.0.66 () {56 vars in 1127 bytes} [Tue Jul 13 08:29:32 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:32.049424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:32.060500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8ae2-5336-48de-983c-3144a31596fc None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:32.066381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:32.067107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:32.067396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:32.067665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:32.068381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] RBAC: Adding query filter params (name=image) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:32.068758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:32.070330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:32.077333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 463/924] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:32 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:32.083855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:32.095239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ef85c-799c-4e38-b5da-bf9a4be8773a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:32.100259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:32.100926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:32.101204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:32.101488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:32.102205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] RBAC: Adding query filter params (type=image) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:32.102505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:32.104140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b938bc-4f34-4b0e-9cfc-de90757eefab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:32.109682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 462/925] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:32 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:32.116127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:32.132870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32c015-362d-4089-9648-f16daa683502 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:32.139939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bff828-af9c-4b38-a9d8-54f34cf724f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:32.141085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bff828-af9c-4b38-a9d8-54f34cf724f4 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:32.141592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bff828-af9c-4b38-a9d8-54f34cf724f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:32.142266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bff828-af9c-4b38-a9d8-54f34cf724f4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:32.144246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bff828-af9c-4b38-a9d8-54f34cf724f4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:32.147264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bff828-af9c-4b38-a9d8-54f34cf724f4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:32.178947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 464/926] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:29:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:29:33.048876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1b79-d406-4080-8510-8db7181bd820 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.049445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1b79-d406-4080-8510-8db7181bd820 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.049445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1b79-d406-4080-8510-8db7181bd820 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.051425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 463/927] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:33.057331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.057833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.057927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.075722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:33.076899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:33.096370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 465/928] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:33.120578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1b79-d406-4080-8510-8db7181bd820 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.132510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1b79-d406-4080-8510-8db7181bd820 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.136982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c652d-80b0-4fd3-815d-e55e2e24804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.137779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c652d-80b0-4fd3-815d-e55e2e24804f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.138056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c652d-80b0-4fd3-815d-e55e2e24804f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.138326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c652d-80b0-4fd3-815d-e55e2e24804f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.139525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c652d-80b0-4fd3-815d-e55e2e24804f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.141228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c652d-80b0-4fd3-815d-e55e2e24804f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.144033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 464/929] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:33.149701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.159473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec79b7-4955-4761-99d4-41ebfade4e03 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.163821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1765c-fc8c-4244-8a00-a6693fc65e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.164486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1765c-fc8c-4244-8a00-a6693fc65e29 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.164769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1765c-fc8c-4244-8a00-a6693fc65e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.165040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1765c-fc8c-4244-8a00-a6693fc65e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.165780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1765c-fc8c-4244-8a00-a6693fc65e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.167717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1765c-fc8c-4244-8a00-a6693fc65e29 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.202938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 466/930] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:33 2021] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:29:33.433821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949fe4-d890-4393-b5f2-13d00c8a0166 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.434039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949fe4-d890-4393-b5f2-13d00c8a0166 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.434322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949fe4-d890-4393-b5f2-13d00c8a0166 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.436406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 465/931] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:33.443963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.444335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.444659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.463675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:33.464836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:33.528835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 467/932] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:33.555188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949fe4-d890-4393-b5f2-13d00c8a0166 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.568226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949fe4-d890-4393-b5f2-13d00c8a0166 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.572544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.573214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.573501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.573771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.586360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:33.593816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:29:33.595265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 466/933] 10.222.0.66 () {56 vars in 1142 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:33.601991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.613588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29886dc-ae1e-43ad-809f-b77b8548fa4b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.617000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.617749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.618107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.618468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.619326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:33.619709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.621416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.631937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 468/934] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:33.638109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.648983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601b0f-c4f5-4f43-a080-7d4f38be7f5a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.653635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.654426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.654700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.654999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.666272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.668200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.687623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:33.688954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 467/935] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:33.694952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.707159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045061a-1209-412b-9b59-caee287ecc14 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.713204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.713586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.713940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.714284 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.715130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:33.715500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.717171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.740332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 469/936] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:33.746336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.756182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e624b3-29cc-4eec-aec8-c0d677b3a06c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.761407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.762864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.763415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.763966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.778675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.781533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.797712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:29:33.799382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 468/937] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:33.805482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.817571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400a8b9-d25a-4c0a-a0ef-f284b34ee09b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.825331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.826678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.827219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.827718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.830118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:33.830710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.832862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.857815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 470/938] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:33.859110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.869522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd77d8-367e-4584-af56-1233da5d5688 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.873832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.874488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.874776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.875058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.884371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.886160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.899554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 469/939] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:33.905627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.917524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53f85-a30b-438d-9b81-e113da3a213d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.922811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.924356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.924822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.924899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.937072 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.939639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.957234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:33.963273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 471/940] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:33.964532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:33.973132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821a489-b425-4cfa-86b4-120ef4775d1a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:33.977504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:33.978171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:33.978449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:33.978716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:33.979467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:33.979775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:33.981411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:33.998981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 470/941] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:34.000212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:34.010584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6cd46-aa7b-43be-a724-2d7d133f4d50 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:34.015045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:34.015847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.016126 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.016400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.024450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:34.026445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:34.040146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:34.046355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 472/942] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:34.047719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:34.058367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1a7a1-f7f4-41a4-ba1b-5e57784b987b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:34.062991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:34.063665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.064553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.064826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.065807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:34.066127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:34.068032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3365d7d-f66b-4cb9-a381-4a313263375f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:34.086949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 471/943] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:34.089614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:34.100580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbd07b-b406-405f-a367-a2c3f05dc8a1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:34.105085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:34.105848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.106199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.106543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.107562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] RBAC: Adding query filter params (role.id=6ec67e4e890e4288af8b6cb98e1c761f, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=3b41f9cf1fe54552abe59a56251cfa7b) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:34.107945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:34.109896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef2e5-b384-47c1-858f-25dcae45bd22 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:34.122952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 473/944] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:34 2021] GET /identity/v3/role_assignments?user.id=3b41f9cf1fe54552abe59a56251cfa7b&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=6ec67e4e890e4288af8b6cb98e1c761f => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:34.447638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb03456-495a-4f43-9e6f-87c7e54cd158 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.448048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb03456-495a-4f43-9e6f-87c7e54cd158 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.448480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb03456-495a-4f43-9e6f-87c7e54cd158 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.450831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 472/945] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:34.457627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304101-a609-4a22-931c-7414e58c2410 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.458017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304101-a609-4a22-931c-7414e58c2410 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.458163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304101-a609-4a22-931c-7414e58c2410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.477187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-86304101-a609-4a22-931c-7414e58c2410 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:34.478359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-86304101-a609-4a22-931c-7414e58c2410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:34.487396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 474/946] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:34.512178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb03456-495a-4f43-9e6f-87c7e54cd158 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:34.524478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb03456-495a-4f43-9e6f-87c7e54cd158 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:34.528858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23137-e818-4e71-ad21-adbc2280202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:34.529497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23137-e818-4e71-ad21-adbc2280202e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.529782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23137-e818-4e71-ad21-adbc2280202e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.530060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23137-e818-4e71-ad21-adbc2280202e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.538772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23137-e818-4e71-ad21-adbc2280202e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:34.540574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23137-e818-4e71-ad21-adbc2280202e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:34.550834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 473/947] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:34.556678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304101-a609-4a22-931c-7414e58c2410 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:34.566286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304101-a609-4a22-931c-7414e58c2410 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:34.571040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfcedc-2b3c-4e15-921d-1c050d0a6592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:34.571993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfcedc-2b3c-4e15-921d-1c050d0a6592 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:34.572275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfcedc-2b3c-4e15-921d-1c050d0a6592 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:34.572555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfcedc-2b3c-4e15-921d-1c050d0a6592 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:34.573987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfcedc-2b3c-4e15-921d-1c050d0a6592 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:34.575913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfcedc-2b3c-4e15-921d-1c050d0a6592 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:34.577796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 475/948] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:35.449051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd7996-2e83-43f2-972e-2f36c20f3cc0 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:35.449604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd7996-2e83-43f2-972e-2f36c20f3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:35.450044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd7996-2e83-43f2-972e-2f36c20f3cc0 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:35.453616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 474/949] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:35 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:35.462739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:35.463611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:35.463759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:35.484396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:35.485925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:35.495909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 476/950] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:35.530586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd7996-2e83-43f2-972e-2f36c20f3cc0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:35.542684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd7996-2e83-43f2-972e-2f36c20f3cc0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:35.547143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047a220-2e93-480e-a25e-49465f9735c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:35.547943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a220-2e93-480e-a25e-49465f9735c5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:35.548818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a220-2e93-480e-a25e-49465f9735c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:35.549300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a220-2e93-480e-a25e-49465f9735c5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:35.550559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047a220-2e93-480e-a25e-49465f9735c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:35.552319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047a220-2e93-480e-a25e-49465f9735c5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:35.553952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 475/951] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:35.560179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:35.570567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df5eb-c2fa-4ea4-b824-aafd89037b91 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:35.575064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07474d89-a169-4752-a0b8-a82bdc62cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:35.575751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474d89-a169-4752-a0b8-a82bdc62cfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:35.576032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474d89-a169-4752-a0b8-a82bdc62cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:35.576303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474d89-a169-4752-a0b8-a82bdc62cfc2 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:35.577018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07474d89-a169-4752-a0b8-a82bdc62cfc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:35.579014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07474d89-a169-4752-a0b8-a82bdc62cfc2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:35.610947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 477/952] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:29:35 2021] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:36.350864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d439-184d-4256-aaa7-297860f84f49 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.351200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d439-184d-4256-aaa7-297860f84f49 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.351431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d439-184d-4256-aaa7-297860f84f49 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.353189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 476/953] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:36.359785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.360250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.361620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.391386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:36.394552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:36.407156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 478/954] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:36.430731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d439-184d-4256-aaa7-297860f84f49 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.444309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d439-184d-4256-aaa7-297860f84f49 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.448457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.449279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.449859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.449859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.461865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:36.469240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:29:36.470638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 477/955] 10.222.0.66 () {56 vars in 1142 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:36.476720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.485500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313e9a7-9db7-46e1-b451-87779a14d771 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.490292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.490988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.491272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.491542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.492344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:36.492596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.494207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.503501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 479/956] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:36.510381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.522143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad259f-1891-4964-b0ba-f3c1d50a85f2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.526870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.527946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.528350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.528634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.539885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.541926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.559315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:36.560574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 478/957] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:36.567787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.577422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3790e16-7a7c-4753-85b2-d3e601a676bc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.582811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.583505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.583782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.584054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.584790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:36.585100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.586713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.600847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 480/958] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:36.606712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.616561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e38e8-4b37-45a8-8d62-6a9102727cd4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.620928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.621708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.621990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.622265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.630668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.632726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.647723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:29:36.648954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 479/959] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:36.655061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.664737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f26912-ef61-4ef9-99f7-b678dbb8fc9c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.669159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.669831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.670111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.670382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.671269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:36.671577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.673568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.692778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 481/960] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:36.699084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.715495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb0510-4c11-4433-a25d-aa644b508c8f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.723155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.724015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.724331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.724603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.736463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.738335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.756462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:36.757605 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 480/961] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:36.763890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.781106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11e978-78a6-4786-a020-d98ce08aed47 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.789360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.790511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.791053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.791547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.792915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:36.793498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.796486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.820277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 482/962] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:36.825950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.835752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab12ae-26bc-47c7-9a1a-fd6950f92a83 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.840312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.841108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.841394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.841706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.849983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.852030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.866632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:36.867936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 481/963] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:36.874572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.891432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d282b-466a-4f0d-bc9a-bceb7f615d2c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.896619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.897305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.897571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.897840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.898635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:36.898976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.900871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2872-b7eb-41a3-8611-c3f31f16829c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.914793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 483/964] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:36.920883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:36.932008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cec3b0-3c56-49af-9a62-8fe276b0f012 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:36.936476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ccf6d-290e-43b9-89f9-4b07312411a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:36.937375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ccf6d-290e-43b9-89f9-4b07312411a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:36.937661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ccf6d-290e-43b9-89f9-4b07312411a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:36.937941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ccf6d-290e-43b9-89f9-4b07312411a9 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/3b41f9cf1fe54552abe59a56251cfa7b/roles/6ec67e4e890e4288af8b6cb98e1c761f` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:36.940877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ccf6d-290e-43b9-89f9-4b07312411a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=3b41f9cf1fe54552abe59a56251cfa7b, role_id=6ec67e4e890e4288af8b6cb98e1c761f)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:36.943579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ccf6d-290e-43b9-89f9-4b07312411a9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:36.957671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 482/965] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:36 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/3b41f9cf1fe54552abe59a56251cfa7b/roles/6ec67e4e890e4288af8b6cb98e1c761f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:37.886899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2750e-0b71-4f58-8009-b8b4a7e49d01 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:37.887502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2750e-0b71-4f58-8009-b8b4a7e49d01 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:37.887502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2750e-0b71-4f58-8009-b8b4a7e49d01 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:37.889313 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 484/966] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:37.895439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:37.895949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:37.896050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:37.914016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:37.915236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:37.977279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 483/967] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:38.003495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2750e-0b71-4f58-8009-b8b4a7e49d01 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:38.015163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2750e-0b71-4f58-8009-b8b4a7e49d01 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:38.020209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:38.021000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:38.021280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:38.021555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:38.032190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:38.040222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:38.041567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 485/968] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:38.048874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:38.057468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455ce7-1b14-4d54-b2e3-b192519b1dde None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:38.061863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:38.062532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:38.062805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:38.063105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:38.063849 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:38.064146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:38.065814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:38.079589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 484/969] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:38.080887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:38.090534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322817f1-a7d0-4b32-a85f-f9d27fcca214 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:38.095568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:38.096442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:38.096722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:38.096991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] PATH_INFO: `/v3/users/d6e9565c9d8d442b998a070af51e7a03` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:38.110608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e9565c9d8d442b998a070af51e7a03)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:38.113534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:38.115314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 486/970] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:38 2021] GET /identity/v3/users/d6e9565c9d8d442b998a070af51e7a03 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:38.121161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:38.130991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12ad8-a66c-49cd-beb9-a3d065cd4690 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:38.136320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:38.137061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:38.137291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:38.137569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:38.146895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:38.148770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:38.158667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 485/971] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:38 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:29:38.164699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:38.174831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60dc20-220b-419d-bcab-554cdd412261 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:38.179177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40510e2-2572-4295-8608-d35e659d4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:38.180035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40510e2-2572-4295-8608-d35e659d4708 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:38.180304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40510e2-2572-4295-8608-d35e659d4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:38.180571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40510e2-2572-4295-8608-d35e659d4708 admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:38.181689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40510e2-2572-4295-8608-d35e659d4708 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:38.183763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40510e2-2572-4295-8608-d35e659d4708 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:38.185396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 487/972] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:29:38 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:38.191932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:38.201246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcab361-390a-42b4-957d-c2fec2a57520 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:38.206559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:38.207258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:38.207539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:38.207814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:38.208769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=dd139877339d4595b277c7c578e05223, user.id=d6e9565c9d8d442b998a070af51e7a03) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:38.208966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:38.210807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f76d-5911-4cb8-a5a4-1afcba2b962f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:38.217831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 486/973] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:38 2021] GET /identity/v3/role_assignments?user.id=d6e9565c9d8d442b998a070af51e7a03&scope.project.id=dd139877339d4595b277c7c578e05223&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:39.134991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e767-35e9-49b7-87ac-1b6ebde40e14 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.135573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e767-35e9-49b7-87ac-1b6ebde40e14 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.135573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e767-35e9-49b7-87ac-1b6ebde40e14 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.137318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 488/974] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:39.143765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.144229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.144399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.164393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:39.165624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:39.176797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 487/975] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:39.201599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2e767-35e9-49b7-87ac-1b6ebde40e14 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.214114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2e767-35e9-49b7-87ac-1b6ebde40e14 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.218374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.219212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.219499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.219774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.230715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:39.241872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 08:29:39.241872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 489/976] 10.222.0.66 () {56 vars in 1142 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:39.246619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.257092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5acc-ccad-4f46-9183-c0f5ed25fa38 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.261670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.262344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.262630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.262899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.263680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:39.263987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.265606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.275044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 488/977] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:39.280956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.291453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0993cd-feb9-4423-ac8c-e2d1bd82b2e2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.296264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.297087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.297373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.297646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.310607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.312667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.333179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:39.334435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 490/978] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:39.340348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.350474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a436e-abe8-4a66-9d5f-aa0d8190bacf admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.354936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.355621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.355906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.356184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.356911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:39.357217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.358824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.371721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 489/979] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:39.378869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.390802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a98ad-fe1e-4999-8ead-6aae34c342d6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.399386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.400862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.401375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.401887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.416517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.420766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.444747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 08:29:39.446015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 491/980] 10.222.0.66 () {56 vars in 1115 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:39.451976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.461913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd41a3-9925-42e7-877c-57ed2ad92a49 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.466408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.467106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.467390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.467665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.468506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:39.468818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.471212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.490595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 490/981] 10.222.0.66 () {56 vars in 1155 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:39.496680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.506961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58dcfe-a81d-4291-aaaa-aec5bc5b7fc3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.511444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.512097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.512377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.512719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.521994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.523810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.532774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 492/982] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:39.538838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.548357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a32db5-1ce6-4789-97e1-888164380ce9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.552902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.553699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.553985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.554255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.566244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.568144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.585846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:29:39.587378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 491/983] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:39.592997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.602455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883acfab-3d37-42f3-b63a-4c935ad5c02c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.609156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.609824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.610104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.610379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.611768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:39.612097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.613818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.631192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 493/984] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:39.632437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.644244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fbcaa-dc88-41ec-b814-de212b9190df admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.649302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.650257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.650555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.650863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.659948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.661933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.676328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:29:39.677571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 492/985] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:39.684046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.694252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90407e01-9af0-4f0f-917d-3b15305383f9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.698936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.699617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.699897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.700179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.700972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:39.701283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.703184 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a76c4a-d497-4cfa-b366-fbab71a3cf66 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.716671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 494/986] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:39.723842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:39.734211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29f16-d0ee-4044-988f-bf9642eef1ec admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:39.739549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:39.740221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:39.740506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:39.740772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:39.741618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] RBAC: Adding query filter params (role.id=6ec67e4e890e4288af8b6cb98e1c761f, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=3b41f9cf1fe54552abe59a56251cfa7b) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:39.741924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:39.743838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48786-c422-41bb-a98c-24b0490b134e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:39.750345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 493/987] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:39 2021] GET /identity/v3/role_assignments?user.id=3b41f9cf1fe54552abe59a56251cfa7b&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=6ec67e4e890e4288af8b6cb98e1c761f => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:40.394154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bea2d-a8a2-4620-80ab-51a3daa89c31 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.394673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bea2d-a8a2-4620-80ab-51a3daa89c31 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.394758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bea2d-a8a2-4620-80ab-51a3daa89c31 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.396524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 495/988] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:40.402640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.403207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.403207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.422548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:40.424433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:40.432020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 494/989] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:40.457224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bea2d-a8a2-4620-80ab-51a3daa89c31 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:40.471247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bea2d-a8a2-4620-80ab-51a3daa89c31 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:40.479630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:40.480459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.480740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.481016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.493846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:40.500821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:40.502980 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 496/990] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:29:40.509596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:40.519683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d899e-39ff-49ac-9420-d66ebd106354 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:40.524482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:40.525183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.525458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.525733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.526502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:40.526812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:40.528536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:40.540511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 495/991] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:40.547075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:40.557244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b883f-155c-4d33-a652-bafe99e5f57f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:40.563148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:40.564113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.564526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.564805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] PATH_INFO: `/v3/users/d6e9565c9d8d442b998a070af51e7a03` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.566204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e9565c9d8d442b998a070af51e7a03)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:40.568481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:40.570175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 497/992] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:40 2021] GET /identity/v3/users/d6e9565c9d8d442b998a070af51e7a03 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:40.577181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:40.588823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8d82-d0b9-4fae-86e5-e1786c0fd886 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:40.594030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea422-4142-490d-ac3a-30bbd092f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:40.595049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea422-4142-490d-ac3a-30bbd092f695 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.596454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea422-4142-490d-ac3a-30bbd092f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.596742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea422-4142-490d-ac3a-30bbd092f695 admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.598046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ea422-4142-490d-ac3a-30bbd092f695 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:40.600230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ea422-4142-490d-ac3a-30bbd092f695 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:40.602058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 496/993] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:29:40 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:40.610387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:40.621136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ed2e1-e233-4362-bd87-4feb22317446 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:40.625725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7b99-3542-43a2-8717-d1e9a9840227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:40.627835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7b99-3542-43a2-8717-d1e9a9840227 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:40.628114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7b99-3542-43a2-8717-d1e9a9840227 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:40.628391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7b99-3542-43a2-8717-d1e9a9840227 admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223/users/d6e9565c9d8d442b998a070af51e7a03/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:40.630373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7b99-3542-43a2-8717-d1e9a9840227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd139877339d4595b277c7c578e05223, user_id=d6e9565c9d8d442b998a070af51e7a03, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:40.633099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7b99-3542-43a2-8717-d1e9a9840227 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:40.648901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 498/994] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:40 2021] PUT /identity/v3/projects/dd139877339d4595b277c7c578e05223/users/d6e9565c9d8d442b998a070af51e7a03/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:29:42.949391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42f38-739e-4353-aa79-c62484fb45cc None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:42.950025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42f38-739e-4353-aa79-c62484fb45cc None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:42.950025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc42f38-739e-4353-aa79-c62484fb45cc None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:42.952640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 497/995] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:42.959054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:42.959636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:42.959636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:42.979941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:42.981154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:43.053691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 499/996] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:43.080311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42f38-739e-4353-aa79-c62484fb45cc None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:43.092377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc42f38-739e-4353-aa79-c62484fb45cc None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:43.098125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:43.098942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:43.099239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:43.099527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:43.114261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:29:43.121224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:29:43.122503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 498/997] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:29:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:29:43.129654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:43.138295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afccf2-191b-4d88-b20a-d11a581707ff None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:43.143872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:43.144569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:43.144850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:43.145129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:43.145890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:43.146198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:43.147884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:43.157971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 500/998] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:29:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:43.164556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:43.174360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d9e9-08c4-4994-b3a6-8f0825063f3e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:43.179079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:43.179967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:43.180247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:43.180521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] PATH_INFO: `/v3/users/d6e9565c9d8d442b998a070af51e7a03` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:43.181768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e9565c9d8d442b998a070af51e7a03)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:43.183985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:43.185627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 499/999] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:43 2021] GET /identity/v3/users/d6e9565c9d8d442b998a070af51e7a03 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:43.193335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:43.203730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18965543-dba0-471f-8bbd-65d7e9433499 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:43.209533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:43.210283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:43.210604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:43.210941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:43.219546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:43.221541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:43.230901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 501/1000] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:29:43.237270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:43.246760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da328e3-496f-4fff-8c45-056ed24a2df6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:43.251894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18373f19-5470-43fc-a47d-1f24e99d8c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:43.252778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373f19-5470-43fc-a47d-1f24e99d8c03 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:43.253047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373f19-5470-43fc-a47d-1f24e99d8c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:43.253317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373f19-5470-43fc-a47d-1f24e99d8c03 admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:43.254518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18373f19-5470-43fc-a47d-1f24e99d8c03 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:43.256612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18373f19-5470-43fc-a47d-1f24e99d8c03 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:43.258313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 500/1001] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:29:43 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:43.264881 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:43.274587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d165f5-6105-48c9-9f22-c4dfa0f2c5e0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:43.279243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:43.279903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:43.280183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:43.280452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:43.281296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=dd139877339d4595b277c7c578e05223, user.id=d6e9565c9d8d442b998a070af51e7a03) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:43.281604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:43.283567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee1b6c-9bd9-4c32-9a6e-0c0c46e6ecd2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:43.290394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 502/1002] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:43 2021] GET /identity/v3/role_assignments?user.id=d6e9565c9d8d442b998a070af51e7a03&scope.project.id=dd139877339d4595b277c7c578e05223&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:45.656511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560b85-3978-4374-bfba-6d53ade72786 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:45.657713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560b85-3978-4374-bfba-6d53ade72786 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:45.657713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560b85-3978-4374-bfba-6d53ade72786 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:45.660121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 501/1003] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:29:45.666389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:45.666977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:45.667085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:45.686175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:45.687436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:45.695021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 503/1004] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:45.722351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560b85-3978-4374-bfba-6d53ade72786 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:45.734480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560b85-3978-4374-bfba-6d53ade72786 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:45.739250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b75a2-266f-452d-a28c-da9f772aa30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:45.740064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b75a2-266f-452d-a28c-da9f772aa30a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:45.740347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b75a2-266f-452d-a28c-da9f772aa30a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:45.740621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b75a2-266f-452d-a28c-da9f772aa30a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:45.741844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b75a2-266f-452d-a28c-da9f772aa30a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:45.743656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b75a2-266f-452d-a28c-da9f772aa30a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:45.745316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 502/1005] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:45.752324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:45.761179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e0892-76cb-466e-a7e1-c482d85fb148 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:45.766426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90d89-9ce8-4894-b6d7-dab9f6071bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:45.768734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90d89-9ce8-4894-b6d7-dab9f6071bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:45.769046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90d89-9ce8-4894-b6d7-dab9f6071bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:45.769319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90d89-9ce8-4894-b6d7-dab9f6071bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:45.770204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d90d89-9ce8-4894-b6d7-dab9f6071bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:45.772444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d90d89-9ce8-4894-b6d7-dab9f6071bb5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:45.795601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 504/1006] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:29:45 2021] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:48.097690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839ff7-8dec-4906-9d79-6330f5309fe7 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.098307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839ff7-8dec-4906-9d79-6330f5309fe7 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.098307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839ff7-8dec-4906-9d79-6330f5309fe7 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.100249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 503/1007] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:48.106516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.107105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.107105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.125800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:48.127642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:48.135201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 505/1008] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:29:48.161777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93839ff7-8dec-4906-9d79-6330f5309fe7 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:48.174710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93839ff7-8dec-4906-9d79-6330f5309fe7 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:48.179112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:48.179987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.180265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.180569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] PATH_INFO: `/v3/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.182109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] RBAC: Authorizing `identity:get_role(role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:48.183171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:48.183171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:29:48.183171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:29:48.184072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:48.185522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 504/1009] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:48 2021] GET /identity/v3/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:48.192232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:48.201515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54849a76-a47f-4a6d-99b8-f616197731cb None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:48.208171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:48.209079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.209350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.209620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] PATH_INFO: `/v3/users/2f8c73acbd314ab09a1c6151154657e0` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.225773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] RBAC: Authorizing `identity:get_user(user_id=2f8c73acbd314ab09a1c6151154657e0)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:48.228078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:48.229871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 506/1010] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:48 2021] GET /identity/v3/users/2f8c73acbd314ab09a1c6151154657e0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:48.236353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:48.246065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bc385-cb1c-4feb-8c75-bcde0d1e93ea admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:48.250678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:48.251559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.251684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.251909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.265422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:48.270038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:48.286241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 505/1011] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:48 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:29:48.293166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:48.309928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5037b-e350-4d12-a076-16b70b604a7d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:48.317986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823dba-746b-4279-97df-dd6773125497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:48.319391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823dba-746b-4279-97df-dd6773125497 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.319799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823dba-746b-4279-97df-dd6773125497 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.320203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823dba-746b-4279-97df-dd6773125497 admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.321975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823dba-746b-4279-97df-dd6773125497 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:48.325467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823dba-746b-4279-97df-dd6773125497 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:48.328745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 507/1012] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:29:48 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:48.335839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:48.345519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf2230-4906-4138-9c9d-5053a3c8ee18 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:48.350773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:48.351413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:48.351695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:48.351969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:48.352823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] RBAC: Adding query filter params (role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=dd139877339d4595b277c7c578e05223, user.id=2f8c73acbd314ab09a1c6151154657e0) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:48.353140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:48.355082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519af08-d4a3-42f9-b9b8-559d679ffdef admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:48.361459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 506/1013] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:48 2021] GET /identity/v3/role_assignments?user.id=2f8c73acbd314ab09a1c6151154657e0&scope.project.id=dd139877339d4595b277c7c578e05223&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:50.635233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd02a-5941-44a0-b197-2729465a6cf5 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:50.635829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd02a-5941-44a0-b197-2729465a6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:50.635829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd02a-5941-44a0-b197-2729465a6cf5 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:50.637575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 508/1014] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:50.645297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:50.645817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:50.646137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:50.670442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:50.672421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:50.684815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 507/1015] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:50.710634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd02a-5941-44a0-b197-2729465a6cf5 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:50.722748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd02a-5941-44a0-b197-2729465a6cf5 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:50.727123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:50.727989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:50.728274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:50.728553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] PATH_INFO: `/v3/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:50.729983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] RBAC: Authorizing `identity:get_role(role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:50.731051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:29:50.731051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:29:50.731051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:29:50.731978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:50.733369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 509/1016] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:50 2021] GET /identity/v3/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:50.743502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:50.759527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea739d-71ca-4ba1-9245-8d7785bdd3d2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:50.767907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:50.769810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:50.770321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:50.770825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] PATH_INFO: `/v3/users/2f8c73acbd314ab09a1c6151154657e0` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:50.772889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] RBAC: Authorizing `identity:get_user(user_id=2f8c73acbd314ab09a1c6151154657e0)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:50.777082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:50.780040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 508/1017] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:50 2021] GET /identity/v3/users/2f8c73acbd314ab09a1c6151154657e0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:50.786321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:50.795883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608281f-e469-4beb-925d-c7d90f8ef5dc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:50.800625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d0fb-578e-4785-b15c-6495765bce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:50.801497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d0fb-578e-4785-b15c-6495765bce1e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:50.801780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d0fb-578e-4785-b15c-6495765bce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:50.802057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d0fb-578e-4785-b15c-6495765bce1e admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:50.803256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d0fb-578e-4785-b15c-6495765bce1e admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:50.805355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d0fb-578e-4785-b15c-6495765bce1e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:50.807104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 510/1018] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:29:50 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:50.814824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:50.831546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4fac3-bd9b-454d-b85d-4a4fb6e05e2b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:50.839180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d4f4-8a32-4379-856c-76224519b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:50.840770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d4f4-8a32-4379-856c-76224519b8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:50.841277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d4f4-8a32-4379-856c-76224519b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:50.841741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d4f4-8a32-4379-856c-76224519b8ef admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223/users/2f8c73acbd314ab09a1c6151154657e0/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:50.845412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d4f4-8a32-4379-856c-76224519b8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd139877339d4595b277c7c578e05223, user_id=2f8c73acbd314ab09a1c6151154657e0, role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:50.850826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d4f4-8a32-4379-856c-76224519b8ef admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:50.868178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 509/1019] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:29:50 2021] PUT /identity/v3/projects/dd139877339d4595b277c7c578e05223/users/2f8c73acbd314ab09a1c6151154657e0/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:29:53.113129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697517e0-3f24-4349-9efd-d093eb687225 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.113675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697517e0-3f24-4349-9efd-d093eb687225 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.113675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697517e0-3f24-4349-9efd-d093eb687225 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.115467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 511/1020] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:53.121771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.122343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.122343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.142448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:53.143919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:53.203774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 510/1021] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:53.229466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697517e0-3f24-4349-9efd-d093eb687225 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:53.243515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697517e0-3f24-4349-9efd-d093eb687225 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:53.248066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:53.248940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.249222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.249494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] PATH_INFO: `/v3/roles/420ddf0d156745a19209ddf5c3d87b73` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.251707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] RBAC: Authorizing `identity:get_role(role_id=420ddf0d156745a19209ddf5c3d87b73)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:53.253347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:53.254765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 512/1022] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:53 2021] GET /identity/v3/roles/420ddf0d156745a19209ddf5c3d87b73 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:53.261075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:53.270675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcce763-54f4-44f9-866f-14a45a664055 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:53.275378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:53.276269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.276547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.276822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] PATH_INFO: `/v3/users/2f8c73acbd314ab09a1c6151154657e0` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.278027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2f8c73acbd314ab09a1c6151154657e0)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:53.280263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:53.282328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 511/1023] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:29:53 2021] GET /identity/v3/users/2f8c73acbd314ab09a1c6151154657e0 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:53.288272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:53.298218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dde55-4b74-43b8-89b3-ce28ed51750d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:53.302615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:53.303299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.303585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.303863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.312017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:53.314525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:53.323648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 513/1024] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:29:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:29:53.331096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:53.340555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f9a16-aa83-4dab-9921-ff422d8160b8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:53.345925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2dbb8-5f71-4cd3-ab08-5b8db707ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:53.346806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dbb8-5f71-4cd3-ab08-5b8db707ce61 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.347201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dbb8-5f71-4cd3-ab08-5b8db707ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.347481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dbb8-5f71-4cd3-ab08-5b8db707ce61 admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.348755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2dbb8-5f71-4cd3-ab08-5b8db707ce61 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:53.350857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2dbb8-5f71-4cd3-ab08-5b8db707ce61 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:53.352664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 512/1025] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:29:53 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:29:53.361730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:53.373648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbeef-2186-42bd-88fc-bf4716536803 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:53.380297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:53.381408 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:53.381902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:53.382407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:53.384006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] RBAC: Adding query filter params (role.id=420ddf0d156745a19209ddf5c3d87b73, scope.project.id=dd139877339d4595b277c7c578e05223, user.id=2f8c73acbd314ab09a1c6151154657e0) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:29:53.384554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:53.388185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfb31f-2263-4ed3-a629-5dddab0d1b14 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:53.399701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 514/1026] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:29:53 2021] GET /identity/v3/role_assignments?user.id=2f8c73acbd314ab09a1c6151154657e0&scope.project.id=dd139877339d4595b277c7c578e05223&role.id=420ddf0d156745a19209ddf5c3d87b73 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:55.579225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c7629-0173-4b5a-bab0-efdc4405f695 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:55.579832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c7629-0173-4b5a-bab0-efdc4405f695 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:55.579832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c7629-0173-4b5a-bab0-efdc4405f695 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:55.581636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 513/1027] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:55.587042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:55.587443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:55.587592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:55.604945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:55.606091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:55.613143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 515/1028] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:55.637778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c7629-0173-4b5a-bab0-efdc4405f695 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:55.649933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c7629-0173-4b5a-bab0-efdc4405f695 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:55.653944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179945e8-707d-4637-9da4-dc4dd6bd7cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:55.654708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179945e8-707d-4637-9da4-dc4dd6bd7cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:55.655018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179945e8-707d-4637-9da4-dc4dd6bd7cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:55.655291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179945e8-707d-4637-9da4-dc4dd6bd7cb5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:55.656389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179945e8-707d-4637-9da4-dc4dd6bd7cb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:55.658815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179945e8-707d-4637-9da4-dc4dd6bd7cb5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:55.660347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 514/1029] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:55.665966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:55.674215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014f22-6104-4c74-8e65-8f357d2a016f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:55.678356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d0df-2d7b-4653-b090-ac857919d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:55.679025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d0df-2d7b-4653-b090-ac857919d329 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:55.679307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d0df-2d7b-4653-b090-ac857919d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:55.679578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d0df-2d7b-4653-b090-ac857919d329 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:55.680278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0d0df-2d7b-4653-b090-ac857919d329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:55.682152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0d0df-2d7b-4653-b090-ac857919d329 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:55.706634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 516/1030] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:29:55 2021] POST /identity/v3/projects => generated 311 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:29:57.877253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ab130-451f-4d21-a884-67975c2b10c0 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:57.877827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ab130-451f-4d21-a884-67975c2b10c0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:57.877827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ab130-451f-4d21-a884-67975c2b10c0 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:57.879577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 515/1031] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:29:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:29:57.885244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:57.885735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:57.885826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:57.905045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:29:57.906207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:29:57.962083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 517/1032] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:29:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:29:57.988759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ab130-451f-4d21-a884-67975c2b10c0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:58.001010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ab130-451f-4d21-a884-67975c2b10c0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:58.005257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c0db-0f0a-4b54-b0f6-b1202c55a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:58.006046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c0db-0f0a-4b54-b0f6-b1202c55a9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:58.006334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c0db-0f0a-4b54-b0f6-b1202c55a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:58.006609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c0db-0f0a-4b54-b0f6-b1202c55a9a3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:58.007796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c0db-0f0a-4b54-b0f6-b1202c55a9a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:58.009495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c0db-0f0a-4b54-b0f6-b1202c55a9a3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:58.011149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 516/1033] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:29:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:29:58.018625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:29:58.027427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aec52-6b8e-40bd-a2f0-5f959793d680 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:29:58.032545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86160678-8a21-4b11-bde9-cb60cf79f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:29:58.033221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86160678-8a21-4b11-bde9-cb60cf79f4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:29:58.033503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86160678-8a21-4b11-bde9-cb60cf79f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:29:58.033776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86160678-8a21-4b11-bde9-cb60cf79f4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:29:58.034490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86160678-8a21-4b11-bde9-cb60cf79f4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:29:58.036473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86160678-8a21-4b11-bde9-cb60cf79f4c1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:29:58.058996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 518/1034] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:29:58 2021] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:30:00.283636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19970-3c66-4ed0-bf1d-e1096fbb7d17 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.284190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19970-3c66-4ed0-bf1d-e1096fbb7d17 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.284190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19970-3c66-4ed0-bf1d-e1096fbb7d17 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.285951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 517/1035] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:00.291544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.292240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.292240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.309924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:00.311121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:00.318786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 519/1036] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:00.343436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19970-3c66-4ed0-bf1d-e1096fbb7d17 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:00.355518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19970-3c66-4ed0-bf1d-e1096fbb7d17 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:00.359748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:00.360702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.360983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.361258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.371465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:30:00.378810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:30:00.380031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 518/1037] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:30:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:00.386317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:00.395686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b955e0-6398-44ce-9576-d1a171e984c4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:00.399997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:00.400651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.400947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.401198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.401939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:00.402241 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:00.403874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:00.412203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 520/1038] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:30:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:00.418181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:00.427755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdd090-bc5e-41db-8570-6e74b71fe72f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:00.432064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:00.432916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.433200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.433478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] PATH_INFO: `/v3/users/1f47f81524f74292a8dacdaaf3d3f874` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.447185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f47f81524f74292a8dacdaaf3d3f874)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:00.449337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:00.451024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 519/1039] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:30:00 2021] GET /identity/v3/users/1f47f81524f74292a8dacdaaf3d3f874 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:00.457497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:00.466468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd443-fb46-43c7-84bd-b3c16ebaf26b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:00.470634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:00.471308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.471587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.471858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.479900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:00.481660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:00.490157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 521/1040] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:30:00 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:30:00.496387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:00.506417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69506e-3bb1-4d9c-8f77-25daf29d25a4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:00.511326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b87b-6eb7-4a30-a0a6-b43d3b016a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:00.512182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b87b-6eb7-4a30-a0a6-b43d3b016a13 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.512461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b87b-6eb7-4a30-a0a6-b43d3b016a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.512736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b87b-6eb7-4a30-a0a6-b43d3b016a13 admin admin] PATH_INFO: `/v3/projects/2da821f739c1498c94b24dfad1cb2b52` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.513864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271b87b-6eb7-4a30-a0a6-b43d3b016a13 admin admin] RBAC: Authorizing `identity:get_project(project_id=2da821f739c1498c94b24dfad1cb2b52)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:00.517062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271b87b-6eb7-4a30-a0a6-b43d3b016a13 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:00.519032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 520/1041] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:30:00 2021] GET /identity/v3/projects/2da821f739c1498c94b24dfad1cb2b52 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:00.526250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:00.534609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc091-aab9-476d-9bf1-79d9d131937b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:00.538900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:00.539571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:00.539853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:00.540133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:00.540962 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=2da821f739c1498c94b24dfad1cb2b52, user.id=1f47f81524f74292a8dacdaaf3d3f874) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:00.541274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:00.543160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df6ddf-0fd6-4b8c-aefd-7d2d6c9b8714 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:00.548826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 522/1042] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:30:00 2021] GET /identity/v3/role_assignments?user.id=1f47f81524f74292a8dacdaaf3d3f874&scope.project.id=2da821f739c1498c94b24dfad1cb2b52&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:02.722628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08599e-ef08-4981-bb2b-2aec82d53b27 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.723193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08599e-ef08-4981-bb2b-2aec82d53b27 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.723193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08599e-ef08-4981-bb2b-2aec82d53b27 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.724953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 521/1043] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:02.730565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.731011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.731145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.748235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:02.749403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:02.757101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 523/1044] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:02.782189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08599e-ef08-4981-bb2b-2aec82d53b27 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:02.794458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08599e-ef08-4981-bb2b-2aec82d53b27 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:02.798603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:02.799414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.799698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.800078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.809898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:30:02.817347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:30:02.818504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 522/1045] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:30:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:02.824615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:02.833306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030e06-d2f8-4025-9128-8f0976d9836b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:02.837462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:02.838105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.838387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.838659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.839418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:02.839721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:02.841293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:02.849344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 524/1046] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:30:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:02.855054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:02.864660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3107888-e262-4e45-b0b2-80a814314752 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:02.868998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:02.869869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.870151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.870424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] PATH_INFO: `/v3/users/1f47f81524f74292a8dacdaaf3d3f874` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.871595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] RBAC: Authorizing `identity:get_user(user_id=1f47f81524f74292a8dacdaaf3d3f874)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:02.873747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:02.875912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 523/1047] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:30:02 2021] GET /identity/v3/users/1f47f81524f74292a8dacdaaf3d3f874 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:02.881937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:02.892856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0464f-2c53-45fe-899b-579115b9389a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:02.897378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44746369-2df5-438f-9e2b-a98655cf057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:02.898238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44746369-2df5-438f-9e2b-a98655cf057b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.898519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44746369-2df5-438f-9e2b-a98655cf057b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.898795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44746369-2df5-438f-9e2b-a98655cf057b admin admin] PATH_INFO: `/v3/projects/2da821f739c1498c94b24dfad1cb2b52` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.899978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44746369-2df5-438f-9e2b-a98655cf057b admin admin] RBAC: Authorizing `identity:get_project(project_id=2da821f739c1498c94b24dfad1cb2b52)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:02.902054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44746369-2df5-438f-9e2b-a98655cf057b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:02.903743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 525/1048] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:30:02 2021] GET /identity/v3/projects/2da821f739c1498c94b24dfad1cb2b52 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:02.910484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:02.919610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e7b6c-0c31-4963-aa93-6bbdca4fba8b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:02.924717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1984237-f6fe-4085-87a7-0bde2334d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:02.925609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1984237-f6fe-4085-87a7-0bde2334d375 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:02.925890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1984237-f6fe-4085-87a7-0bde2334d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:02.926165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1984237-f6fe-4085-87a7-0bde2334d375 admin admin] PATH_INFO: `/v3/projects/2da821f739c1498c94b24dfad1cb2b52/users/1f47f81524f74292a8dacdaaf3d3f874/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:02.928050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1984237-f6fe-4085-87a7-0bde2334d375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da821f739c1498c94b24dfad1cb2b52, user_id=1f47f81524f74292a8dacdaaf3d3f874, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:02.930694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1984237-f6fe-4085-87a7-0bde2334d375 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:02.944596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 524/1049] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:30:02 2021] PUT /identity/v3/projects/2da821f739c1498c94b24dfad1cb2b52/users/1f47f81524f74292a8dacdaaf3d3f874/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:30:05.098238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83febf-0566-4669-9f5f-ed63df2fae96 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.098777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83febf-0566-4669-9f5f-ed63df2fae96 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.098777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83febf-0566-4669-9f5f-ed63df2fae96 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.100583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 526/1050] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:05.106187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.106668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.106756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.123865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:05.125619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:05.182065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 525/1051] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:05.208844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83febf-0566-4669-9f5f-ed63df2fae96 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:05.220794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83febf-0566-4669-9f5f-ed63df2fae96 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:05.226012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:05.226791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.227101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.227376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.238330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:30:05.245395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:30:05.246628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 527/1052] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:30:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:05.253463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:05.261821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c9383-2379-4f1a-871d-a6f02f595312 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:05.266109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:05.266768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.267152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.267432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.268446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:05.268754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:05.270400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:05.279072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 526/1053] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:30:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:05.285173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:05.294742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b66c3-8bbd-436a-991a-a46a01ebd4b6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:05.299568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:05.300475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.300700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.300974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] PATH_INFO: `/v3/users/1f47f81524f74292a8dacdaaf3d3f874` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.302120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] RBAC: Authorizing `identity:get_user(user_id=1f47f81524f74292a8dacdaaf3d3f874)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:05.304291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:05.305836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 528/1054] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:30:05 2021] GET /identity/v3/users/1f47f81524f74292a8dacdaaf3d3f874 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:05.311692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:05.321412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be472a-784c-4782-82c8-31f46cca6af2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:05.325773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:05.326425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.326712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.327016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.335772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:05.337540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:05.346832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 527/1055] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:30:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:30:05.353085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:05.362677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913a3d5-68e3-42f1-b128-c7bfe9cd4f2a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:05.366979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243796cc-2635-412b-9108-825694716e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:05.367828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243796cc-2635-412b-9108-825694716e6a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.368106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243796cc-2635-412b-9108-825694716e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.368384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243796cc-2635-412b-9108-825694716e6a admin admin] PATH_INFO: `/v3/projects/2da821f739c1498c94b24dfad1cb2b52` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.369491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243796cc-2635-412b-9108-825694716e6a admin admin] RBAC: Authorizing `identity:get_project(project_id=2da821f739c1498c94b24dfad1cb2b52)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:05.371586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243796cc-2635-412b-9108-825694716e6a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:05.373226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 529/1056] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:30:05 2021] GET /identity/v3/projects/2da821f739c1498c94b24dfad1cb2b52 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:05.379609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:05.388043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377c59-2728-4672-bb7a-49b9749aeab4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:05.393292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:05.393950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:05.394231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:05.394508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:05.395372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=2da821f739c1498c94b24dfad1cb2b52, user.id=1f47f81524f74292a8dacdaaf3d3f874) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:05.395684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:05.397546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ffbce-b733-4660-b953-9d14bfb0d375 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:05.403836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 528/1057] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:30:05 2021] GET /identity/v3/role_assignments?user.id=1f47f81524f74292a8dacdaaf3d3f874&scope.project.id=2da821f739c1498c94b24dfad1cb2b52&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:07.561941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582ca5-443f-4dc1-9996-4ca7a7de9fbb None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:07.562573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582ca5-443f-4dc1-9996-4ca7a7de9fbb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:07.563198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582ca5-443f-4dc1-9996-4ca7a7de9fbb None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:07.565424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 530/1058] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:07.571262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:07.571846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:07.571846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:07.589471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:07.590650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:07.598526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 529/1059] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:07.622546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582ca5-443f-4dc1-9996-4ca7a7de9fbb None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:07.633871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582ca5-443f-4dc1-9996-4ca7a7de9fbb None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:07.637904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:07.638534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:07.638821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:07.639130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:07.647366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:07.649104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:07.657826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 531/1060] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:30:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:30:07.663747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:07.671863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c38334-39dd-47ea-94dd-fc2e422bfaa4 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:07.676012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:07.676780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:07.677057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:07.677328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:07.683872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:07.685671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:07.699242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-ace75ad7-162a-4298-8383-89050fe3de2f admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 08:30:07.700360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 530/1061] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:30:07 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:07.706868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:07.714940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e39e1-7c14-4658-87a4-e23772a9e527 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:07.719880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:07.720517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:07.720797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:07.721069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:07.721781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:07.722084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:07.723703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32785e3-3d41-4915-96ec-34abb496b813 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:07.730737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 532/1062] 10.222.0.66 () {56 vars in 1137 bytes} [Tue Jul 13 08:30:07 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:09.861481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38783e5-f585-4b05-b659-f3d89dbcd3f2 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:09.862046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38783e5-f585-4b05-b659-f3d89dbcd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:09.862046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38783e5-f585-4b05-b659-f3d89dbcd3f2 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:09.863816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 531/1063] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:09.869059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a618c0-1af9-4f1e-a9e6-b4a8b546aa04 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:09.869438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a618c0-1af9-4f1e-a9e6-b4a8b546aa04 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:09.869622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a618c0-1af9-4f1e-a9e6-b4a8b546aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:09.886995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d8a618c0-1af9-4f1e-a9e6-b4a8b546aa04 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:09.888149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d8a618c0-1af9-4f1e-a9e6-b4a8b546aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:09.896309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 533/1064] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:30:09.920000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38783e5-f585-4b05-b659-f3d89dbcd3f2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:09.932139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38783e5-f585-4b05-b659-f3d89dbcd3f2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:09.936241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:09.936872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:09.937157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:09.937536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:09.938273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:09.939295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:30:09.939295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:30:09.939295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:30:09.940176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddce91-6ee6-466e-a745-580e7ae8e81b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:09.954702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 532/1065] 10.222.0.66 () {60 vars in 1160 bytes} [Tue Jul 13 08:30:09 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:30:12.122150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041d78-e555-4719-ae2f-0e1e0ca00c38 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:12.122694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041d78-e555-4719-ae2f-0e1e0ca00c38 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:12.122694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041d78-e555-4719-ae2f-0e1e0ca00c38 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:12.124515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 534/1066] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:12.131243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:12.131763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:12.131872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:12.151829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:12.153019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:12.211351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 533/1067] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:30:12.236969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041d78-e555-4719-ae2f-0e1e0ca00c38 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:12.248417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041d78-e555-4719-ae2f-0e1e0ca00c38 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:12.252785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3962f0b-308f-4c4a-a151-d013582fbc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:12.253628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962f0b-308f-4c4a-a151-d013582fbc3d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:12.253911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962f0b-308f-4c4a-a151-d013582fbc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:12.254189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962f0b-308f-4c4a-a151-d013582fbc3d admin admin] PATH_INFO: `/v3/domains/b13a83e754a046f2a3048607d09f293d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:12.264715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3962f0b-308f-4c4a-a151-d013582fbc3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=b13a83e754a046f2a3048607d09f293d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:12.267698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3962f0b-308f-4c4a-a151-d013582fbc3d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:12.269377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 535/1068] 10.222.0.66 () {56 vars in 1205 bytes} [Tue Jul 13 08:30:12 2021] GET /identity/v3/domains/b13a83e754a046f2a3048607d09f293d => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:12.275406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:12.285014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f3bac-dfb1-436d-b605-11517332d9c5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:12.289312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419165-55f0-488c-a957-d3552a7bb2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:12.289959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419165-55f0-488c-a957-d3552a7bb2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:12.290240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419165-55f0-488c-a957-d3552a7bb2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:12.290514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419165-55f0-488c-a957-d3552a7bb2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:12.291261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74419165-55f0-488c-a957-d3552a7bb2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:12.293154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74419165-55f0-488c-a957-d3552a7bb2f9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:12.319490 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 534/1069] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:30:12 2021] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:30:14.530065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb69c8-5098-44bb-bc5c-11f49a9b0f0c None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:14.530599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb69c8-5098-44bb-bc5c-11f49a9b0f0c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:14.530712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb69c8-5098-44bb-bc5c-11f49a9b0f0c None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:14.534464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 536/1070] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:14.540510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:14.541031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:14.541128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:14.559043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:14.560233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:14.618287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 535/1071] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:14.645222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb69c8-5098-44bb-bc5c-11f49a9b0f0c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:14.656735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb69c8-5098-44bb-bc5c-11f49a9b0f0c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:14.660871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac15c4-f5d6-49d1-bd4b-2261bd5c51e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:14.661711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac15c4-f5d6-49d1-bd4b-2261bd5c51e8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:14.661991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac15c4-f5d6-49d1-bd4b-2261bd5c51e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:14.662260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac15c4-f5d6-49d1-bd4b-2261bd5c51e8 admin admin] PATH_INFO: `/v3/domains/b13a83e754a046f2a3048607d09f293d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:14.663423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac15c4-f5d6-49d1-bd4b-2261bd5c51e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=b13a83e754a046f2a3048607d09f293d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:14.665377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac15c4-f5d6-49d1-bd4b-2261bd5c51e8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:14.666929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 537/1072] 10.222.0.66 () {56 vars in 1205 bytes} [Tue Jul 13 08:30:14 2021] GET /identity/v3/domains/b13a83e754a046f2a3048607d09f293d => generated 267 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:14.672792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:14.680983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8a812-1216-4308-9dbd-805b2d29efea None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:14.685103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f202b-153f-4c6a-810d-debaa9f8308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:14.685757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f202b-153f-4c6a-810d-debaa9f8308b admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:14.686035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f202b-153f-4c6a-810d-debaa9f8308b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:14.686305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f202b-153f-4c6a-810d-debaa9f8308b admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:14.687028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f202b-153f-4c6a-810d-debaa9f8308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:14.689443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f202b-153f-4c6a-810d-debaa9f8308b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:14.709824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 536/1073] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:30:14 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:30:16.943708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca558183-db1c-4515-a981-0952f7942ba3 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:16.944247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca558183-db1c-4515-a981-0952f7942ba3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:16.944247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca558183-db1c-4515-a981-0952f7942ba3 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:16.946017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 538/1074] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:16.951545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:16.952007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:16.952106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:16.969702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:16.970857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:16.978068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 537/1075] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:17.002990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca558183-db1c-4515-a981-0952f7942ba3 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:17.015568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca558183-db1c-4515-a981-0952f7942ba3 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:17.021121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:17.021925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:17.022201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:17.022472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:17.035847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:30:17.043272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:30:17.044531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 539/1076] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:30:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:17.051776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:17.060225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6a9b-fdbf-4af1-8bb5-9fefb36b4a50 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:17.064486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:17.065145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:17.065424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:17.065694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:17.066425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:17.066730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:17.068351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:17.076632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 538/1077] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:30:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:30:17.082569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:17.091838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b3e6-765b-46f2-856c-7580a8391920 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:17.096749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:17.097607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:17.097887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:17.098161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] PATH_INFO: `/v3/users/82e09095234b46289147a8eb49063172` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:17.114291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=82e09095234b46289147a8eb49063172)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:17.116489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:17.118157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 540/1078] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:30:17 2021] GET /identity/v3/users/82e09095234b46289147a8eb49063172 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:17.124654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:17.133637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d505d-d05d-49be-afb0-699eb4be6652 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:17.137925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:17.138555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:17.138828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:17.139185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:17.147019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:17.148761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:17.157373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 539/1079] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:30:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:30:17.163411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:17.179286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979e85-3828-47b7-8b2b-d7a248ea41c6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:17.183782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83b468-ffd5-4bf5-b5ff-063bbfbcb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:17.184675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83b468-ffd5-4bf5-b5ff-063bbfbcb254 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:17.184949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83b468-ffd5-4bf5-b5ff-063bbfbcb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:17.185294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83b468-ffd5-4bf5-b5ff-063bbfbcb254 admin admin] PATH_INFO: `/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:17.186421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83b468-ffd5-4bf5-b5ff-063bbfbcb254 admin admin] RBAC: Authorizing `identity:get_project(project_id=e97a5cd07f5b45a4ba5edf08aa370dbd)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:17.188904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83b468-ffd5-4bf5-b5ff-063bbfbcb254 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:17.190597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 541/1080] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:30:17 2021] GET /identity/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd => generated 361 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:17.197241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:17.206001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eb613-7df9-49b7-b0e0-ae8ad47eec85 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:17.210235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:17.210865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:17.211174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:17.211446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:17.212254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=e97a5cd07f5b45a4ba5edf08aa370dbd, user.id=82e09095234b46289147a8eb49063172) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:17.212561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:17.214382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e9a5-cf6b-46d4-8bca-2c77a15b048c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:17.221203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 540/1081] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:30:17 2021] GET /identity/v3/role_assignments?user.id=82e09095234b46289147a8eb49063172&scope.project.id=e97a5cd07f5b45a4ba5edf08aa370dbd&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:19.373083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37f46-2ffd-4b51-972b-5a22d44a89b8 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.373612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37f46-2ffd-4b51-972b-5a22d44a89b8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.373612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37f46-2ffd-4b51-972b-5a22d44a89b8 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.376354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 542/1082] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:19.382945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.383456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.383768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.404573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:19.405748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:19.413430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 541/1083] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:19.438589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b37f46-2ffd-4b51-972b-5a22d44a89b8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:19.450698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b37f46-2ffd-4b51-972b-5a22d44a89b8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:19.455848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:19.456636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.456916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.457188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.467616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:30:19.474365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:30:19.475590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 543/1084] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:30:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:19.481853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:19.490871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57487-dcb6-4a55-a1cd-94521b16e112 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:19.495238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:19.495846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.496130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.496403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.497139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:19.497446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:19.499072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:19.508216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 542/1085] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:30:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:19.514160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:19.524158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c75d8a-6ea2-4e99-a433-188647153ff2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:19.528479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:19.529336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.529613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.529916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] PATH_INFO: `/v3/users/82e09095234b46289147a8eb49063172` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.531438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] RBAC: Authorizing `identity:get_user(user_id=82e09095234b46289147a8eb49063172)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:19.533455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:19.535107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 544/1086] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:30:19 2021] GET /identity/v3/users/82e09095234b46289147a8eb49063172 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:19.541219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:19.551950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0620d7-5593-4047-adb1-b3cb34dce642 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:19.556320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50d1e9-c913-4b61-bb1e-0c9c9c81fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:19.557191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d1e9-c913-4b61-bb1e-0c9c9c81fd8c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.557488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d1e9-c913-4b61-bb1e-0c9c9c81fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.557759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d1e9-c913-4b61-bb1e-0c9c9c81fd8c admin admin] PATH_INFO: `/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.559044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50d1e9-c913-4b61-bb1e-0c9c9c81fd8c admin admin] RBAC: Authorizing `identity:get_project(project_id=e97a5cd07f5b45a4ba5edf08aa370dbd)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:19.561171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50d1e9-c913-4b61-bb1e-0c9c9c81fd8c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:19.563770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 543/1087] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:30:19 2021] GET /identity/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:19.570036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:19.580598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b24de-dd0c-4369-af97-ac7e9e7f8931 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:19.585040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f74eaf-da54-4d08-9b88-e21759cc2058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:19.585935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f74eaf-da54-4d08-9b88-e21759cc2058 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:19.586209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f74eaf-da54-4d08-9b88-e21759cc2058 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:19.586476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f74eaf-da54-4d08-9b88-e21759cc2058 admin admin] PATH_INFO: `/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd/users/82e09095234b46289147a8eb49063172/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:19.588392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f74eaf-da54-4d08-9b88-e21759cc2058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a5cd07f5b45a4ba5edf08aa370dbd, user_id=82e09095234b46289147a8eb49063172, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:19.591078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f74eaf-da54-4d08-9b88-e21759cc2058 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:19.608485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 545/1088] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:30:19 2021] PUT /identity/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd/users/82e09095234b46289147a8eb49063172/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:30:21.770078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67832-ad43-4063-ac05-a19bdb6b9b80 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:21.770800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67832-ad43-4063-ac05-a19bdb6b9b80 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:21.770800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67832-ad43-4063-ac05-a19bdb6b9b80 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:21.772566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 544/1089] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:30:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:30:21.778067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:21.778632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:21.778632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:21.794963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:30:21.796619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:30:21.849907 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 546/1090] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:30:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:30:21.876173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b67832-ad43-4063-ac05-a19bdb6b9b80 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:21.888039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b67832-ad43-4063-ac05-a19bdb6b9b80 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:21.893395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:21.894184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:21.894465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:21.894739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:21.905397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:30:21.912308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:30:21.913548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 545/1091] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:30:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:30:21.920090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:21.929148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88af65-7f47-40f4-a27f-d9d4b053986d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:21.933507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:21.934173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:21.934459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:21.934736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:21.935530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:21.935838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:21.938157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:21.946939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 547/1092] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:30:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:21.953111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:21.963286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ca18-8e79-4e32-b475-017d88c22526 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:21.967566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:21.968550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:21.968829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:21.969098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] PATH_INFO: `/v3/users/82e09095234b46289147a8eb49063172` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:21.970364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] RBAC: Authorizing `identity:get_user(user_id=82e09095234b46289147a8eb49063172)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:21.972513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:21.974094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 546/1093] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:30:21 2021] GET /identity/v3/users/82e09095234b46289147a8eb49063172 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:30:21.980233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:21.990096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9eeff1-8c07-4993-9dd4-b86983be7888 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:21.994455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:21.995144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:21.995430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:21.995709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:22.004427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:22.006242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:22.015481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 548/1094] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:30:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:30:22.022257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:22.031333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf4d0-0412-4f81-841b-47d79d95005e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:22.035677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089ed6-eb6b-475a-ad16-7b6b2b73e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:22.036521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089ed6-eb6b-475a-ad16-7b6b2b73e281 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:22.036800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089ed6-eb6b-475a-ad16-7b6b2b73e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:22.037080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089ed6-eb6b-475a-ad16-7b6b2b73e281 admin admin] PATH_INFO: `/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:22.038195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089ed6-eb6b-475a-ad16-7b6b2b73e281 admin admin] RBAC: Authorizing `identity:get_project(project_id=e97a5cd07f5b45a4ba5edf08aa370dbd)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:22.040263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089ed6-eb6b-475a-ad16-7b6b2b73e281 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:22.041902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 547/1095] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:30:22 2021] GET /identity/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:30:22.049608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:30:22.058082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04359f3-7048-4ee0-b505-821400101747 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:30:22.063221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:30:22.063872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:30:22.064153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:30:22.064452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:30:22.065283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=e97a5cd07f5b45a4ba5edf08aa370dbd, user.id=82e09095234b46289147a8eb49063172) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:30:22.065598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:30:22.067554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf4e1-aa6e-421a-8a8c-a54dd746faac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:30:22.073861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 549/1096] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:30:22 2021] GET /identity/v3/role_assignments?user.id=82e09095234b46289147a8eb49063172&scope.project.id=e97a5cd07f5b45a4ba5edf08aa370dbd&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:19.851826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccab65-7857-4b87-8de2-ae0718640e7e None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:19.852580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccab65-7857-4b87-8de2-ae0718640e7e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:19.852580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccab65-7857-4b87-8de2-ae0718640e7e None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:19.854934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 548/1097] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:31:19.862283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:19.863230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:19.863230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:19.885245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:19.886597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:19.896707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 550/1098] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:19.923378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccab65-7857-4b87-8de2-ae0718640e7e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:19.939838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccab65-7857-4b87-8de2-ae0718640e7e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:19.945102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:19.945924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:19.946237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:19.946522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:19.960529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:19.962484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:19.982675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:19.983968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 549/1099] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:19.992007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:20.012086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c904af-5531-4e71-a5b0-82a9b07710e3 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:20.019842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:20.021108 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:20.021706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:20.022062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:20.022824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:20.023340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:20.024935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7342fd8-051b-4b19-9e3d-a70494a88639 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:20.047041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 551/1100] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:20.048338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:20.058988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cb945-d394-46b4-abf5-4938ab110cad admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:20.064464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57599e-9031-4beb-bcbf-95fe7c3bf742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:20.065206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57599e-9031-4beb-bcbf-95fe7c3bf742 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:20.065498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57599e-9031-4beb-bcbf-95fe7c3bf742 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:20.065774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57599e-9031-4beb-bcbf-95fe7c3bf742 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:20.066499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57599e-9031-4beb-bcbf-95fe7c3bf742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:20.068719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57599e-9031-4beb-bcbf-95fe7c3bf742 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:20.105101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 550/1101] 10.222.0.66 () {60 vars in 1154 bytes} [Tue Jul 13 08:31:20 2021] POST /identity/v3/users => generated 251 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:31:22.533086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908742f-ffb7-40cd-b1a9-314b7918980e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.533952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908742f-ffb7-40cd-b1a9-314b7918980e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.533952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908742f-ffb7-40cd-b1a9-314b7918980e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.535958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 552/1102] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:22.542446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.543226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.543226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.566981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:22.568526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:22.582842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 551/1103] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:22.615896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908742f-ffb7-40cd-b1a9-314b7918980e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:22.630715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908742f-ffb7-40cd-b1a9-314b7918980e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:22.639378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:22.640979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.641460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.641930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.662377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:31:22.672754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:31:22.679388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 553/1104] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:31:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:22.680643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:22.690776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f84f9-03ad-4371-9a97-24d628de130a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:22.696282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:22.697136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.697427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.697706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.698519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:22.698823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:22.700713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:22.713112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 552/1105] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:31:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:22.719119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:22.738167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b85db-d47f-4800-b0ba-4e6d90098710 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:22.749985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:22.751132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.751499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.751867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.770665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:22.772886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:22.804550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:22.806153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 554/1106] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:22.817268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:22.831759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05295a73-ee01-4e42-bafd-71efdb74304c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:22.837822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:22.838612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.839225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.839534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.840881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:22.841811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:22.843619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:22.859479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 553/1107] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:22.865658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:22.876479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55744b3-15c7-4f52-acf4-580e5ee39980 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:22.890194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:22.891911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.892567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.893122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.909386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:22.915152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:22.940428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:31:22.942646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 555/1108] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:22.952095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:22.964643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d953b-695b-4e8a-a8ac-43567bc306b1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:22.974598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:22.975332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:22.975623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:22.975886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:22.976729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:22.977037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:22.978953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.008046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 554/1109] 10.222.0.66 () {56 vars in 1165 bytes} [Tue Jul 13 08:31:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:23.020706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:23.034615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd546e3-a165-4f1a-ab2a-7f1b07e4c3ba admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:23.041544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:23.042684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:23.043322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:23.043833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:23.061559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:23.065329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.081516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 556/1110] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:31:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:31:23.088315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:23.106384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f0e66-efa7-4a63-b5e8-3a71065373d8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:23.112903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:23.114314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:23.114817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:23.115370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:23.136323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:23.140283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.166182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:23.174629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 555/1111] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:23.176404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:23.188863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfc844-d113-4260-a668-66b419baa9ee admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:23.195613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:23.196603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:23.197186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:23.197610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:23.198813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:23.199452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:23.202386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.221242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 557/1112] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:23.226306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:23.237349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5d4de-4dfa-4294-bd65-253a0778a82b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:23.251708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:23.252920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:23.253554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:23.253866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:23.267503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:23.271046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.291033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:31:23.297926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 556/1113] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:31:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:23.299524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:23.310666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad060c-8bb3-433c-8b67-cf0d35047a76 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:23.315856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:23.316508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:23.316791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:23.317095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:23.317908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:23.318246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:23.320344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151bb17-944b-455c-b7cb-cfd8f443da34 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.336734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 558/1114] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:31:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:23.343875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:23.355072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277040ae-8c18-479d-b23b-7a926144b34a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:23.360726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:23.361685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:23.362126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:23.362406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:23.363404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=056919d757294178b647759f5c9809c1) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:23.363922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:23.365794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3e5e-20e4-4c9c-b337-672fdb3684fc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:23.372957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 557/1115] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:31:23 2021] GET /identity/v3/role_assignments?user.id=056919d757294178b647759f5c9809c1&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:25.609086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b20d-55c7-4c5b-a35b-06c7b25ec384 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.609675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b20d-55c7-4c5b-a35b-06c7b25ec384 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.609675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b20d-55c7-4c5b-a35b-06c7b25ec384 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.611424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 559/1116] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:31:25.618636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.619220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.619312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.637706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:25.639062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:25.647580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 558/1117] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:25.674156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b20d-55c7-4c5b-a35b-06c7b25ec384 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:25.690720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b20d-55c7-4c5b-a35b-06c7b25ec384 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:25.695283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:25.696115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.696377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.696622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.708204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:31:25.715319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:31:25.716751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 560/1118] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:31:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:25.723277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:25.732704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad1b0-b85e-4c90-8031-bace62f92c99 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:25.738321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:25.739083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.739440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.739718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.740556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:25.740943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:25.742853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:25.758104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 559/1119] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:31:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:25.765631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:25.779914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47e0c-1b9b-48c6-97b9-eb62e6427e02 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:25.785172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:25.786125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.786517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.786991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.801007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:25.803141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:25.824218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:25.825829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 561/1120] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:25.833553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:25.846980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c92f9-6289-4463-ac70-52ed8fe1fb9e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:25.852269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:25.852947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.853239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.853512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.854301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:25.854617 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:25.857123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:25.883726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 560/1121] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:25.885002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:25.896858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5bdc-0a79-42b0-ac9d-5368f5fe75b2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:25.906675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:25.908331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.908968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.909465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.924102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:25.928148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:25.954412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:31:25.956002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 562/1122] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:25 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:25.963504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:25.974565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010323-2447-4a26-97f0-9ffab2bbb220 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:25.980056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:25.980821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:25.981192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:25.981486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:25.982393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:25.982702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:25.984989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:26.021153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 561/1123] 10.222.0.66 () {56 vars in 1165 bytes} [Tue Jul 13 08:31:25 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:26.028530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:26.040251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14cb06-ee46-4208-b743-ca5886119483 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:26.046349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:26.047197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:26.047476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:26.047744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:26.063876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:26.066039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:26.095493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:26.097706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 563/1124] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:26.107562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:26.124099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e141e-bf75-4155-955f-8337c86ff036 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:26.131180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:26.132356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:26.132863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:26.133328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:26.134802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:26.135378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:26.139230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:26.158683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 562/1125] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:26.165755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:26.190551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0703715-9693-4313-b305-7cee64d7fe17 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:26.197991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:26.199045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:26.199567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:26.200739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:26.209045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:26.211199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:26.225489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:31:26.227063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 564/1126] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:31:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:26.234082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:26.245144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ed7e-c426-4631-8b75-2d3832514f51 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:26.251623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:26.252516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:26.252811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:26.253213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:26.254004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:26.254314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:26.256209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba19a-438f-4d86-bb52-f32675f12a64 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:26.269958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 563/1127] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:31:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:26.276478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:26.290833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea7ec-9f65-4aee-a989-398a57996c89 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:26.296586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe8c9-4fdb-4164-abd2-18dcf291ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:26.297539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe8c9-4fdb-4164-abd2-18dcf291ba31 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:26.297895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe8c9-4fdb-4164-abd2-18dcf291ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:26.298117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe8c9-4fdb-4164-abd2-18dcf291ba31 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/056919d757294178b647759f5c9809c1/roles/66256c2103a145b38a649c50e6af642c` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:26.315737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe8c9-4fdb-4164-abd2-18dcf291ba31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=056919d757294178b647759f5c9809c1, role_id=66256c2103a145b38a649c50e6af642c)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:26.318542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe8c9-4fdb-4164-abd2-18dcf291ba31 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:26.335219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 565/1128] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:31:26 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/056919d757294178b647759f5c9809c1/roles/66256c2103a145b38a649c50e6af642c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:31:28.569705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab0427-62a2-4344-97e3-a5908afcfa7e None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.570293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab0427-62a2-4344-97e3-a5908afcfa7e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.570293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab0427-62a2-4344-97e3-a5908afcfa7e None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.572297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 564/1129] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:28.578695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.579174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.579335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.597838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:28.599038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:28.661734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 566/1130] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:28.689244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab0427-62a2-4344-97e3-a5908afcfa7e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.702544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab0427-62a2-4344-97e3-a5908afcfa7e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.707313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.708007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.708287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.708569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.720616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:31:28.727810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 08:31:28.729177 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 565/1131] 10.222.0.66 () {56 vars in 1124 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:28.736187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.745233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44940502-aafd-4609-a1ac-03a87c3d8808 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.750353 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.751044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.751327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.751602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.752398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] RBAC: Adding query filter params (name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:28.752676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:28.754265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:28.763949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 567/1132] 10.222.0.66 () {56 vars in 1125 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:28.769963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.781351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80489a-5d7b-45db-bfe9-84718cec0c9a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.786551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.787529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.787814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.788092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.801260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:28.803376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:28.823917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:28.825075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 566/1133] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:28.831035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.840808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49766-e1af-49a5-be39-71e8c6fded30 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.845274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.845931 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.846217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.846482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.847242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:28.847538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:28.849138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:28.863184 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 568/1134] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:28.869043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.884570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c09e2-9aee-4db9-9f86-781a094d5858 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.892402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.893747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.894204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.894687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.909075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:28.912438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:28.928493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:31:28.929793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 567/1135] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:28.936061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.947221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009cd5d-ca01-433f-a2f6-9e3c78f0d5c0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.952312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.953141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:28.953430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:28.953750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:28.954620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:28.955055 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:28.957141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:28.978499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 569/1136] 10.222.0.66 () {56 vars in 1165 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:28.985304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:28.994451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6b1d-6548-4474-9d91-a1a0d15a7662 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:28.999166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:28.999841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:29.000112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:29.000380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:29.008799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:29.010585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:29.019643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 568/1137] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:31:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:31:29.026151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:29.038294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ffc9a-fde1-45c7-a14a-2c41a0dcdc33 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:29.044525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:29.045426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:29.045657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:29.045982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:29.060439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:29.062314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:29.087485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:29.088713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 570/1138] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:29.098457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:29.108014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caac4e8-c069-4f2b-9b2a-59a99f1510ed admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:29.112430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:29.113085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:29.113367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:29.113688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:29.114423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:29.114843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:29.116560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:29.129818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 569/1139] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:29.136006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:29.146796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4366-da3e-4036-9b33-0ec27049fe41 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:29.151668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:29.153001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:29.153381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:29.153736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:29.160965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:29.162896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:29.178853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:31:29.180117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 571/1140] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:31:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:29.186738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:29.196387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73dfc-61c0-4c79-9ff4-669146df40f2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:29.201807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:29.202462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:29.202744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:29.203055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:29.203860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:29.204153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:29.206509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb3461-3a3e-404d-baba-256f55113335 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:29.220903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 570/1141] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:31:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:29.228223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:29.239770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d890-0061-41d5-8a18-e20e23b41949 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:29.244471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:29.245122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:29.245404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:29.245678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:29.246968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] RBAC: Adding query filter params (role.id=66256c2103a145b38a649c50e6af642c, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=056919d757294178b647759f5c9809c1) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:29.246968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:29.248849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f5193-229f-40d7-ae2e-3602e850a4d0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:29.256330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 572/1142] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:31:29 2021] GET /identity/v3/role_assignments?user.id=056919d757294178b647759f5c9809c1&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=66256c2103a145b38a649c50e6af642c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:31.548377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d101764-42c7-45a4-8e38-ee2bdae8eac8 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.548895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d101764-42c7-45a4-8e38-ee2bdae8eac8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.548990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d101764-42c7-45a4-8e38-ee2bdae8eac8 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.550682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 571/1143] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:31.556341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.556764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.556976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.575267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:31.576451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:31.583705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 573/1144] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:31:31.608878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d101764-42c7-45a4-8e38-ee2bdae8eac8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.622338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d101764-42c7-45a4-8e38-ee2bdae8eac8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.627124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.628121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.628504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.628828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.642005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:31:31.648925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:31:31.650116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 572/1145] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:31.657232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.666258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420a2e-16ae-488a-8198-4231aee4df79 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.671811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.672496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.672782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.673058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.673843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:31.674123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.675777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:31.689415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 574/1146] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:31.697192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.711270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bec23-a415-4876-bf97-183c3738fcf9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.716516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.717295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.717584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.717895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.730216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.732971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:31.751566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:31.752804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 573/1147] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:31.764301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.775173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718147d1-07eb-43ed-8652-2174b1a04278 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.787814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.788478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.788758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.789029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.789767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:31.790064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.791717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:31.805870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 575/1148] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:31.812759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.822448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b190d9-1eb0-4e56-8f23-0d39e857dc61 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.827084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.827892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.828169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.828440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.837080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.839316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:31.856255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:31:31.857704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 574/1149] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:31.865128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.875614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc91189-0f88-4954-a5bc-a622651d7eaf admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.880138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.880822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.881098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.881369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.882207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:31.882512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.884418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:31.906244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 576/1150] 10.222.0.66 () {56 vars in 1165 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:31.912230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.923184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f80a4a-559d-462e-9377-c6495e1ce7b4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.928072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.928747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.929033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.929379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.940850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.942773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:31.952598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 575/1151] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:31:31.959099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:31.971134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd3306-8cc3-4ebd-a0d7-5ab6acbefe60 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:31.978094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:31.979499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:31.980061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:31.981153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:31.995764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:31.998308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:32.019583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:32.021063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 577/1152] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:32.026994 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:32.036239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2aa85-25fe-4b73-8561-958771fecd96 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:32.040802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:32.041469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:32.041752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:32.042026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:32.042764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:32.044313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:32.045978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:32.065247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 576/1153] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:32.073945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:32.085105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da068eae-6f2f-4e11-ad85-ccb0b813944b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:32.090282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:32.091306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:32.091664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:32.091926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:32.099866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:32.101945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:32.116019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:31:32.117300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 578/1154] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:31:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:32.124382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:32.133984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db59ab4-0546-4c99-b393-92cdf20c5afc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:32.138732 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:32.139430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:32.139709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:32.139983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:32.141110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:32.141345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:32.143424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381445e-c24c-4e36-be3e-909a56ccaca9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:32.156743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 577/1155] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:31:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:32.163377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:32.173973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0878-d469-4705-ac62-68176e65bf43 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:32.178312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:32.179010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:32.179327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:32.179630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:32.180449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=056919d757294178b647759f5c9809c1) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:32.180750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:32.182580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cb969-914f-4919-a6d4-ea851b29a2fa admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:32.189214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 579/1156] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:31:32 2021] GET /identity/v3/role_assignments?user.id=056919d757294178b647759f5c9809c1&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=620fb448cda4468da4c7442522368bea => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:34.436762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35776-010e-4962-9710-573f4f7860fb None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.437288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35776-010e-4962-9710-573f4f7860fb None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.437288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35776-010e-4962-9710-573f4f7860fb None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.439091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 578/1157] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:31:34.444678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.445138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.445247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.464093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:34.465339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:34.474238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 580/1158] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:34.500789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec35776-010e-4962-9710-573f4f7860fb None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.514373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec35776-010e-4962-9710-573f4f7860fb None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.519234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.520169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.520525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.520918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.531825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:31:34.538619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:31:34.540038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 579/1159] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:34.546936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.561048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b747d0-8251-4881-8cfd-9c8bec0b1220 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.567437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.568106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.568387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.568659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.569413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:34.569721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.571377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.582818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 581/1160] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:34.590725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.601651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6a07-af68-4020-928f-5f81b688367f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.607102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.608184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.608410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.608713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.621862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.623759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.643804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:34.645383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 580/1161] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:34.654839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.661771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571dea7-dd81-4cf6-96a0-5459bd992db4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.670517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.671289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.671577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.671851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.672585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:34.672928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.674662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.688947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 582/1162] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:34.695192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.712452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196e185-04bb-4bdf-99fd-be08f45c0b9f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.721088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.721978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.722359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.722630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.732664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.734866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.751870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:31:34.753060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 581/1163] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:34.759592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.772559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf21c92-5e1d-4c26-bd83-e7af9b9d5753 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.778124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.778892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.779243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.779540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.780397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:34.780708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.782631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.805226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 583/1164] 10.222.0.66 () {56 vars in 1165 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:34.813827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.825324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01088c-f33e-4bc8-b498-d362b2171f99 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.830458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.831490 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.831897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.832297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.844925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.846698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.863782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:34.864967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 582/1165] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:34.870798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.880709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4265e4f-819a-4a4c-be8d-112ed34fbb0f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.885316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.885974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.886248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.886550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.888154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:34.888264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.889837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.905498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 584/1166] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:34.912628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.922700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d66c0-4264-4e20-acab-54a95ef7cca8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.928393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.929331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.929740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.930108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.938600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.940635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.955109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:31:34.956306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 583/1167] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:34.962412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:34.974295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf1fd-8304-4d8a-b65b-247ef953c243 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:34.979213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:34.979881 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:34.980159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:34.980452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:34.981251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:34.981594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:34.983535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8f5d4-25b4-45cc-9fc1-b681ef535dcc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:34.999694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 585/1168] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:31:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:35.005967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:35.016556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d575a-0144-4e16-8371-16c29b4f0d61 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:35.021285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb61015-9e53-47bd-aba7-23f9ceb31187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:35.022165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb61015-9e53-47bd-aba7-23f9ceb31187 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:35.022491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb61015-9e53-47bd-aba7-23f9ceb31187 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:35.022803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb61015-9e53-47bd-aba7-23f9ceb31187 admin admin] PATH_INFO: `/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/056919d757294178b647759f5c9809c1/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:35.024679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb61015-9e53-47bd-aba7-23f9ceb31187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8f21c7bebb45a986d9b39b4416b709, user_id=056919d757294178b647759f5c9809c1, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:35.027485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb61015-9e53-47bd-aba7-23f9ceb31187 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:35.046623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 584/1169] 10.222.0.66 () {58 vars in 1461 bytes} [Tue Jul 13 08:31:35 2021] PUT /identity/v3/projects/ea8f21c7bebb45a986d9b39b4416b709/users/056919d757294178b647759f5c9809c1/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:31:37.497330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d84869-b25f-49a5-b6c7-3fb41e21b0ba None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.497851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d84869-b25f-49a5-b6c7-3fb41e21b0ba None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.497851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d84869-b25f-49a5-b6c7-3fb41e21b0ba None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.499935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 586/1170] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:37.506659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.507541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.507724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.527441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:37.529127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:37.600814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 585/1171] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:31:37.626207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d84869-b25f-49a5-b6c7-3fb41e21b0ba None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.640624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d84869-b25f-49a5-b6c7-3fb41e21b0ba None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.646760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.647616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.648423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.648423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.672767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 08:31:37.679788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 08:31:37.681060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 587/1172] 10.222.0.66 () {56 vars in 1118 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:37.687766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.696589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1ca48-c0d5-4f5e-bf48-1e9dc4a94f68 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.701580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.702332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.702509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.702772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.703612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:37.703920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:37.709848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:37.725740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 586/1173] 10.222.0.66 () {56 vars in 1121 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:37.736848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.752560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897379b3-cf40-4654-a101-10ac25a89083 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.758850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.760214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.760702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.761102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.776594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:37.779451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:37.798112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:37.799393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 588/1174] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:37.805862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.816974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639549aa-37b9-42a3-b645-90be681931e6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.821761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.822446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.822731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.823049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.824410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:37.824886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:37.826673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:37.841769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 587/1175] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:31:37.849290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.862809 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817058-d638-4e55-beda-9ac29db821ba admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.869826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.871422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.871981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.872249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.882014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:37.884346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:37.901328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 08:31:37.902786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 589/1176] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:37.909069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.921440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc7150-8ad2-4cac-ac3c-5aa1f506e489 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.926468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.927197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.927511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.927758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.929344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:37.929807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:37.932035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:37.959244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 588/1177] 10.222.0.66 () {56 vars in 1165 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:37.965717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:37.975796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d86af-833d-4264-b971-4c9ab9db6bf4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:37.981116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:37.981772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:37.982057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:37.982390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:37.991083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:37.993040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:38.003243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 590/1178] 10.222.0.66 () {58 vars in 1325 bytes} [Tue Jul 13 08:31:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:31:38.009509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:38.019835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2293-19bb-4bbf-9828-88eb1197cfe7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:38.025587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:38.026575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:38.026889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:38.027307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:38.038522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:38.040421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:38.064883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 08:31:38.066544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 589/1179] 10.222.0.66 () {56 vars in 1130 bytes} [Tue Jul 13 08:31:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:38.072189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:38.081701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103921-4395-4282-bc13-e9460322b416 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:38.088561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:38.089753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:38.090243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:38.090737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:38.092106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:38.092653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:38.095665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:38.109719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 591/1180] 10.222.0.66 () {56 vars in 1131 bytes} [Tue Jul 13 08:31:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:38.120625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:38.131567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c1593-e50f-4869-9598-acc6f5187752 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:38.139133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:38.140470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:38.140901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:38.141277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:38.152247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:38.154947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:38.175795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING keystone.server.flask.application [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 08:31:38.176083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 590/1181] 10.222.0.66 () {56 vars in 1133 bytes} [Tue Jul 13 08:31:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 08:31:38.182430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:38.193074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d1ca6-f332-4c69-83c5-bf0bd3cb4c7f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:38.198617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:38.199933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:38.200223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:38.200492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:38.201338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:38.201648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:38.203681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1b9c2-0a5e-45ff-8450-a3a19b0776d5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:38.217422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 592/1182] 10.222.0.66 () {56 vars in 1170 bytes} [Tue Jul 13 08:31:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:38.223806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:38.238377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee503e-cbbe-4b46-98ff-5486c367574a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:38.248975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:38.250012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:38.250452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:38.250928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:38.252171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] RBAC: Adding query filter params (role.id=620fb448cda4468da4c7442522368bea, scope.project.id=ea8f21c7bebb45a986d9b39b4416b709, user.id=056919d757294178b647759f5c9809c1) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:38.252480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:38.254390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e6aec-aae6-4817-b907-8770f5a536f1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:38.260648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 591/1183] 10.222.0.66 () {56 vars in 1396 bytes} [Tue Jul 13 08:31:38 2021] GET /identity/v3/role_assignments?user.id=056919d757294178b647759f5c9809c1&scope.project.id=ea8f21c7bebb45a986d9b39b4416b709&role.id=620fb448cda4468da4c7442522368bea => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:40.571897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b25e5-af70-4a2f-8ef9-88fc3ff722f2 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:40.572484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b25e5-af70-4a2f-8ef9-88fc3ff722f2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:40.572484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b25e5-af70-4a2f-8ef9-88fc3ff722f2 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:40.574232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 593/1184] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:40.579357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:40.579790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:40.579921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:40.596237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:40.597375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:40.604425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 592/1185] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:40.628128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b25e5-af70-4a2f-8ef9-88fc3ff722f2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:40.647533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b25e5-af70-4a2f-8ef9-88fc3ff722f2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:40.651657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:40.653235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:40.653544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:40.653811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:40.654464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:40.656122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:40.667380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:31:40.669090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 594/1186] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:31:40 2021] GET /identity/v3/services/placement => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:40.675308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:40.684341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32657561-bf97-4e31-b016-ae814b0f8681 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:40.688627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:40.689285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:40.689567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:40.689842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:40.690555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:40.690869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:40.692496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68efd-2839-4781-af4c-3987bd855ae9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:40.697541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 593/1187] 10.222.0.66 () {56 vars in 1138 bytes} [Tue Jul 13 08:31:40 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:40.703934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:40.713051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccc49a-3abd-4af0-9479-5a7c80001db0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:40.717479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:40.718135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:40.718420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:40.718698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] PATH_INFO: `/v3/services` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:40.719440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:40.719746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:40.721343 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b5415-1a00-464a-b17d-b6f346863b49 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:40.726103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 595/1188] 10.222.0.66 () {56 vars in 1138 bytes} [Tue Jul 13 08:31:40 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:42.927237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034b176-47fa-4e18-9afd-bae910b2ac7f None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:42.927793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034b176-47fa-4e18-9afd-bae910b2ac7f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:42.927793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034b176-47fa-4e18-9afd-bae910b2ac7f None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:42.929533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 594/1189] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:42.935003 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad328ab-cc0b-4aef-be99-864ec4e44c6a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:42.935460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad328ab-cc0b-4aef-be99-864ec4e44c6a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:42.935563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad328ab-cc0b-4aef-be99-864ec4e44c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:42.953094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-aad328ab-cc0b-4aef-be99-864ec4e44c6a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:42.954245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-aad328ab-cc0b-4aef-be99-864ec4e44c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:42.961211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 596/1190] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:42.985646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034b176-47fa-4e18-9afd-bae910b2ac7f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:42.996949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034b176-47fa-4e18-9afd-bae910b2ac7f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:43.000997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020872cd-021e-46ec-b4aa-0918e79d649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:43.001643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020872cd-021e-46ec-b4aa-0918e79d649d admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:43.001927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020872cd-021e-46ec-b4aa-0918e79d649d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:43.002204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020872cd-021e-46ec-b4aa-0918e79d649d admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:43.002933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020872cd-021e-46ec-b4aa-0918e79d649d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:43.004571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020872cd-021e-46ec-b4aa-0918e79d649d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:43.018249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 595/1191] 10.222.0.66 () {60 vars in 1163 bytes} [Tue Jul 13 08:31:42 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:31:45.384022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976501e-4830-4546-95ae-2fc495dab2bd None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:45.384568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976501e-4830-4546-95ae-2fc495dab2bd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:45.384568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976501e-4830-4546-95ae-2fc495dab2bd None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:45.387014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 597/1192] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:45.392639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:45.393058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:45.393194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:45.410226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:45.411422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:45.427304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 596/1193] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:45.452310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976501e-4830-4546-95ae-2fc495dab2bd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:45.463786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976501e-4830-4546-95ae-2fc495dab2bd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:45.467897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:45.468667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:45.468944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:45.469214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:45.469858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:45.471488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:45.482234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:31:45.483384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 598/1194] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:31:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:45.489434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:45.498361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec4d6a-9171-4778-98ce-95cd0d585903 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:45.502508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:45.503186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:45.503476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:45.503746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:45.504442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] RBAC: Adding query filter params (name=placement) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:45.504748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:45.506350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:45.512034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 597/1195] 10.222.0.66 () {56 vars in 1138 bytes} [Tue Jul 13 08:31:45 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:45.517924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:45.526747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e305d9-38f1-4100-90ff-67eed52eed8c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:45.530873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:45.531540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:45.531820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:45.532093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:45.532868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] RBAC: Adding query filter params (interface=public, service_id=6a96e19718bb48b5b0ecb9f25059794a, region_id=RegionOne) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:45.533177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:45.534745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6424-21a1-4328-8919-1a0ecf86c9be admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:45.539690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 599/1196] 10.222.0.66 () {56 vars in 1273 bytes} [Tue Jul 13 08:31:45 2021] GET /identity/v3/endpoints?service_id=6a96e19718bb48b5b0ecb9f25059794a&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:45.545306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:45.554034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7144-7dce-4e0b-bd42-d009cf7021ac admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:45.558981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c41f8-d535-4c01-b762-8b4426c2e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:45.559626 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c41f8-d535-4c01-b762-8b4426c2e2fc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:45.559907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c41f8-d535-4c01-b762-8b4426c2e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:45.560182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c41f8-d535-4c01-b762-8b4426c2e2fc admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:45.560848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c41f8-d535-4c01-b762-8b4426c2e2fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:45.562415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c41f8-d535-4c01-b762-8b4426c2e2fc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:45.569081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 598/1197] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:31:45 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:31:47.726666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e29d9-9f65-48d4-8bc9-61bbc73a8db5 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:47.727257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e29d9-9f65-48d4-8bc9-61bbc73a8db5 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:47.727257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e29d9-9f65-48d4-8bc9-61bbc73a8db5 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:47.729032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 600/1198] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:31:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:31:47.735186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:47.735646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:47.735795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:47.752953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:31:47.754126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:31:47.761466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 599/1199] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:31:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:31:47.786600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e29d9-9f65-48d4-8bc9-61bbc73a8db5 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:47.799013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e29d9-9f65-48d4-8bc9-61bbc73a8db5 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:47.803157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:47.803948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:47.804230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:47.804506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:47.805154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:47.806764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:47.817998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING keystone.server.flask.application [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 08:31:47.819236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 601/1200] 10.222.0.66 () {56 vars in 1139 bytes} [Tue Jul 13 08:31:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 08:31:47.825765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:47.834069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8ede0-1a35-498b-bf0c-81cb85cbd4f5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:47.838303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:47.839530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:47.839824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:47.840097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] PATH_INFO: `/v3/services` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:47.841015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] RBAC: Adding query filter params (name=placement) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:31:47.841316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:47.842935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117b381-9e6f-42d7-9594-a1cf6046f7ed admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:47.848172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 600/1201] 10.222.0.66 () {56 vars in 1138 bytes} [Tue Jul 13 08:31:47 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:31:47.853884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:31:47.864107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ec5d5-59b1-4b33-b5a0-17209ee1dbd2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:31:47.868276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6bc07-8d6d-4c6d-bfeb-8bef47470f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:31:47.868911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6bc07-8d6d-4c6d-bfeb-8bef47470f93 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:31:47.869190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6bc07-8d6d-4c6d-bfeb-8bef47470f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:31:47.869459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6bc07-8d6d-4c6d-bfeb-8bef47470f93 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:31:47.870185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6bc07-8d6d-4c6d-bfeb-8bef47470f93 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:31:47.871811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6bc07-8d6d-4c6d-bfeb-8bef47470f93 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:31:47.890735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 602/1202] 10.222.0.66 () {60 vars in 1166 bytes} [Tue Jul 13 08:31:47 2021] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:32:52.862384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ce765-52c4-436a-8490-7c1bee90902f None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:52.862829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ce765-52c4-436a-8490-7c1bee90902f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:52.863128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ce765-52c4-436a-8490-7c1bee90902f None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:52.865131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 601/1203] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:32:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:32:52.870446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035b3c-0e31-4aa9-a9f5-c366366fe73f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:52.870849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035b3c-0e31-4aa9-a9f5-c366366fe73f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:52.871122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7035b3c-0e31-4aa9-a9f5-c366366fe73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:52.959519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f7035b3c-0e31-4aa9-a9f5-c366366fe73f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:32:52.961231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f7035b3c-0e31-4aa9-a9f5-c366366fe73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:53.073188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 603/1204] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:32:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:32:53.097135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ce765-52c4-436a-8490-7c1bee90902f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:32:53.098858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-402ce765-52c4-436a-8490-7c1bee90902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:53.227490 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ce765-52c4-436a-8490-7c1bee90902f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:32:53.329197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef21d2-7729-462a-8e72-07d6d07b57e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:32:53.329936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef21d2-7729-462a-8e72-07d6d07b57e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:53.330226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef21d2-7729-462a-8e72-07d6d07b57e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:53.330502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef21d2-7729-462a-8e72-07d6d07b57e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:53.331271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef21d2-7729-462a-8e72-07d6d07b57e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:32:53.333149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef21d2-7729-462a-8e72-07d6d07b57e2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:32:53.353855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 602/1205] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:32:53 2021] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:32:55.516053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be03b1-b726-456e-845d-e967b998461a None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:55.516555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be03b1-b726-456e-845d-e967b998461a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:55.516555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be03b1-b726-456e-845d-e967b998461a None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:55.518271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 604/1206] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:32:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:32:55.524216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1a424-6a3f-4aee-aec7-a23a2c765bb4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:55.524684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1a424-6a3f-4aee-aec7-a23a2c765bb4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:55.524776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1a424-6a3f-4aee-aec7-a23a2c765bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:55.602654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-48f1a424-6a3f-4aee-aec7-a23a2c765bb4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:32:55.603834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-48f1a424-6a3f-4aee-aec7-a23a2c765bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:55.695907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 603/1207] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:32:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:32:55.745515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856622b-ae88-4a5f-b397-1d2072b3f773 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:55.745797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856622b-ae88-4a5f-b397-1d2072b3f773 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:55.746071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856622b-ae88-4a5f-b397-1d2072b3f773 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:55.747849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 605/1208] 10.222.0.66 () {54 vars in 964 bytes} [Tue Jul 13 08:32:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:32:55.753854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ab3eb-4249-435a-9e92-e11041ab89e2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:55.754137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ab3eb-4249-435a-9e92-e11041ab89e2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:55.754413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ab3eb-4249-435a-9e92-e11041ab89e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:55.827448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-fd2ab3eb-4249-435a-9e92-e11041ab89e2 None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:32:55.828596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fd2ab3eb-4249-435a-9e92-e11041ab89e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:55.901258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 604/1209] 10.222.0.66 () {58 vars in 1062 bytes} [Tue Jul 13 08:32:55 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:32:55.910608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856622b-ae88-4a5f-b397-1d2072b3f773 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:32:55.912132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1856622b-ae88-4a5f-b397-1d2072b3f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:56.013969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856622b-ae88-4a5f-b397-1d2072b3f773 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:32:56.084087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:32:56.084651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:56.084930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:56.085204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:56.087268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:56.191912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:32:56.193365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5f95a-9a8b-4c6d-bf1c-96973de1883d service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:32:56.211836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 606/1210] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:32:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:32:58.618662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f336d5-f654-4edb-ab16-ec3f6c7e354a None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:58.619248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f336d5-f654-4edb-ab16-ec3f6c7e354a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:58.619248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f336d5-f654-4edb-ab16-ec3f6c7e354a None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:58.621010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 605/1211] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:32:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:32:58.626329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ecf6-c560-4684-9747-1313c6f724e6 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:58.626756 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ecf6-c560-4684-9747-1313c6f724e6 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:58.626872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ecf6-c560-4684-9747-1313c6f724e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:58.690778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5838ecf6-c560-4684-9747-1313c6f724e6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:32:58.692059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5838ecf6-c560-4684-9747-1313c6f724e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:58.785619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 607/1212] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:32:58.842498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1d8d-50a9-45d1-bf6b-536f2abe0abb None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:58.842800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1d8d-50a9-45d1-bf6b-536f2abe0abb None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:58.843115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1d8d-50a9-45d1-bf6b-536f2abe0abb None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:58.844877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 606/1213] 10.222.0.66 () {54 vars in 964 bytes} [Tue Jul 13 08:32:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:32:58.850936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e47f-1af9-4ca7-896f-b632710e638c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:58.851257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e47f-1af9-4ca7-896f-b632710e638c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:58.852157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e47f-1af9-4ca7-896f-b632710e638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:58.925799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-60b7e47f-1af9-4ca7-896f-b632710e638c None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:32:58.926893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-60b7e47f-1af9-4ca7-896f-b632710e638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:59.000755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 608/1214] 10.222.0.66 () {58 vars in 1062 bytes} [Tue Jul 13 08:32:58 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:32:59.010060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1d8d-50a9-45d1-bf6b-536f2abe0abb None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:32:59.011725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4baa1d8d-50a9-45d1-bf6b-536f2abe0abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:59.114570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1d8d-50a9-45d1-bf6b-536f2abe0abb None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:32:59.186861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:32:59.187456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:32:59.187740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:32:59.188017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:32:59.189629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:32:59.299402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:32:59.300848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ffaab-2182-427c-b308-3e2ac5606d49 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:32:59.318081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 607/1215] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:32:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:02.015704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2b292-bd42-43fd-91d9-c2a72bdd08f6 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:02.016254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2b292-bd42-43fd-91d9-c2a72bdd08f6 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:02.016254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2b292-bd42-43fd-91d9-c2a72bdd08f6 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:02.018046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 609/1216] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:02.023662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:02.024116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:02.024211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:02.088304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:02.089534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:02.179113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 608/1217] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:02.214145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2b292-bd42-43fd-91d9-c2a72bdd08f6 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:02.215679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3bd2b292-bd42-43fd-91d9-c2a72bdd08f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:02.333665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2b292-bd42-43fd-91d9-c2a72bdd08f6 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:02.421069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90bcc1-18ce-4b50-9c8c-27ec27dd39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:02.421910 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bcc1-18ce-4b50-9c8c-27ec27dd39a1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:02.422184 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bcc1-18ce-4b50-9c8c-27ec27dd39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:02.422450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bcc1-18ce-4b50-9c8c-27ec27dd39a1 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:02.431878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90bcc1-18ce-4b50-9c8c-27ec27dd39a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:02.433943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90bcc1-18ce-4b50-9c8c-27ec27dd39a1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:02.435725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 610/1218] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:33:02 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:33:02.448557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:02.449706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:02.533774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9831347-f6c9-4d9e-9d79-5ea63b0b50c2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:02.601665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:02.602226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:02.602509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:02.602779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:02.604610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:02.708902 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:02.710344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff607f8d-8bb9-4370-82eb-bc6d9c419831 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:02.728784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 609/1219] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:05.413483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e81c-28d7-414f-a7f5-af4bb396cdd8 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:05.414195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e81c-28d7-414f-a7f5-af4bb396cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:05.414195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e81c-28d7-414f-a7f5-af4bb396cdd8 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:05.415847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 611/1220] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:05.421392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:05.421792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:05.421944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:05.483504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:05.484670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:05.577380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 610/1221] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:05.611256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392e81c-28d7-414f-a7f5-af4bb396cdd8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:05.612719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1392e81c-28d7-414f-a7f5-af4bb396cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:05.735380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392e81c-28d7-414f-a7f5-af4bb396cdd8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:05.828328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ef9e7-297e-4ad8-8c8a-fd9eb6d3c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:05.829098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ef9e7-297e-4ad8-8c8a-fd9eb6d3c865 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:05.829378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ef9e7-297e-4ad8-8c8a-fd9eb6d3c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:05.829653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ef9e7-297e-4ad8-8c8a-fd9eb6d3c865 admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:05.839773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ef9e7-297e-4ad8-8c8a-fd9eb6d3c865 admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:05.841867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ef9e7-297e-4ad8-8c8a-fd9eb6d3c865 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:05.843614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 612/1222] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:33:05 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:33:05.855402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:05.856569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:05.945642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869d82-08cf-4df2-9fe0-ad5db105df54 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:06.017027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:06.017676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:06.018012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:06.018262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:06.019914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:06.179146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:06.182568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335144a-37fc-4f2e-a15e-377a4b53be51 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:06.207659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 611/1223] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:09.384754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa0eae-c6d3-4c89-a875-0e177018b105 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:09.385310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa0eae-c6d3-4c89-a875-0e177018b105 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:09.385464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa0eae-c6d3-4c89-a875-0e177018b105 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:09.388870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 613/1224] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:09.394417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd3f2c-73ae-43aa-90ff-b86e48e07869 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:09.394828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd3f2c-73ae-43aa-90ff-b86e48e07869 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:09.395001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd3f2c-73ae-43aa-90ff-b86e48e07869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:09.465859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a7cd3f2c-73ae-43aa-90ff-b86e48e07869 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:09.467127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a7cd3f2c-73ae-43aa-90ff-b86e48e07869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:09.564768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 612/1225] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:09.603357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa0eae-c6d3-4c89-a875-0e177018b105 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:09.605019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b9fa0eae-c6d3-4c89-a875-0e177018b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:09.719584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa0eae-c6d3-4c89-a875-0e177018b105 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:09.793071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:09.793713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:09.793991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:09.794261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:09.795928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:09.907511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:09.908905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000aa06-88fe-4a8a-bd8a-0d5a1a5391a1 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:09.926603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 614/1226] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:12.377138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c00f8-85db-4d83-beab-0a3e84416964 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:12.377749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c00f8-85db-4d83-beab-0a3e84416964 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:12.377749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c00f8-85db-4d83-beab-0a3e84416964 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:12.379624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 613/1227] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:12.384995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1575-bedd-46ef-add4-b8d04173f6d7 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:12.385469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1575-bedd-46ef-add4-b8d04173f6d7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:12.385578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1575-bedd-46ef-add4-b8d04173f6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:12.453598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-762e1575-bedd-46ef-add4-b8d04173f6d7 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:12.455009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-762e1575-bedd-46ef-add4-b8d04173f6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:12.570416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 615/1228] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:12.616716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c00f8-85db-4d83-beab-0a3e84416964 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:12.618194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-096c00f8-85db-4d83-beab-0a3e84416964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:12.721760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c00f8-85db-4d83-beab-0a3e84416964 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:12.795911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:12.796573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:12.796859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:12.797140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:12.798775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:12.913770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:12.915443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5b04a-9216-46ae-a403-24552c6a04aa service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:12.934058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 614/1229] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:15.168889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45e26-8008-447f-8c60-0c53e7d66127 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:15.169447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45e26-8008-447f-8c60-0c53e7d66127 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:15.169447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45e26-8008-447f-8c60-0c53e7d66127 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:15.171329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 616/1230] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:15.177400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:15.177941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:15.177941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:15.244196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:15.245327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:15.344280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 615/1231] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:15.378691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45e26-8008-447f-8c60-0c53e7d66127 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:15.380220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7dd45e26-8008-447f-8c60-0c53e7d66127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:15.501243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45e26-8008-447f-8c60-0c53e7d66127 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:15.590958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c725cc8-839b-4054-967e-886bc83167ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:15.591812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725cc8-839b-4054-967e-886bc83167ac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:15.592097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725cc8-839b-4054-967e-886bc83167ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:15.592370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725cc8-839b-4054-967e-886bc83167ac admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:15.602512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c725cc8-839b-4054-967e-886bc83167ac admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:15.604627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c725cc8-839b-4054-967e-886bc83167ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:15.606289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 617/1232] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:33:15 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:33:15.617925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:15.619221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:15.710777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8de9-3cf5-4cbc-afb1-f2b6bb5681ee None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:15.781131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:15.781692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:15.781976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:15.782253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:15.783863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:15.886033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:15.887774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa8ade-9f06-4521-b9de-68114b585d00 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:15.905162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 616/1233] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:18.308770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371798c-cafb-4c05-8138-5ac315275bd7 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:18.309336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371798c-cafb-4c05-8138-5ac315275bd7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:18.309336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371798c-cafb-4c05-8138-5ac315275bd7 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:18.311185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 618/1234] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:18.316349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99004d8b-5694-475f-ae46-d95e40892205 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:18.316788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99004d8b-5694-475f-ae46-d95e40892205 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:18.316884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99004d8b-5694-475f-ae46-d95e40892205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:18.379275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-99004d8b-5694-475f-ae46-d95e40892205 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:18.380432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-99004d8b-5694-475f-ae46-d95e40892205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:18.471414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 617/1235] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:33:18.507371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371798c-cafb-4c05-8138-5ac315275bd7 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:18.508849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a371798c-cafb-4c05-8138-5ac315275bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:18.610874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371798c-cafb-4c05-8138-5ac315275bd7 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:18.684857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:18.685505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:18.685781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:18.686050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:18.687660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:18.797623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:18.799130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aee28-fc92-4b1f-bb16-e0f856265a38 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:18.816785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 619/1236] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:21.034333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987379c-f45d-48a5-b919-c2c7f3e98027 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:21.034953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987379c-f45d-48a5-b919-c2c7f3e98027 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:21.034953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987379c-f45d-48a5-b919-c2c7f3e98027 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:21.036710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 618/1237] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:21.043222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7c34-caca-445d-8f4f-fbb8456dea84 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:21.043825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7c34-caca-445d-8f4f-fbb8456dea84 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:21.043825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7c34-caca-445d-8f4f-fbb8456dea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:21.118566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-83fa7c34-caca-445d-8f4f-fbb8456dea84 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:21.119892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-83fa7c34-caca-445d-8f4f-fbb8456dea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:21.218721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 620/1238] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:21.259277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987379c-f45d-48a5-b919-c2c7f3e98027 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:21.260754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e987379c-f45d-48a5-b919-c2c7f3e98027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:21.364423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987379c-f45d-48a5-b919-c2c7f3e98027 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:21.439960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:21.440620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:21.440901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:21.441171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:21.442750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:21.549480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:21.550970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80a651-65e8-4dc5-8719-ff97f6df3895 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:21.570137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 619/1239] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:24.120098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ca4b-9b33-493b-861d-fc03a046a4bd None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:24.120661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ca4b-9b33-493b-861d-fc03a046a4bd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:24.120661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ca4b-9b33-493b-861d-fc03a046a4bd None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:24.122438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 621/1240] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:24.128065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f4ab-23a1-42b8-87fd-d52816a3c4bd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:24.128545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f4ab-23a1-42b8-87fd-d52816a3c4bd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:24.128642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f4ab-23a1-42b8-87fd-d52816a3c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:24.206025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9153f4ab-23a1-42b8-87fd-d52816a3c4bd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:24.207237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9153f4ab-23a1-42b8-87fd-d52816a3c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:24.316537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 620/1241] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:24.353565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359ca4b-9b33-493b-861d-fc03a046a4bd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:24.355744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0359ca4b-9b33-493b-861d-fc03a046a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:24.454412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359ca4b-9b33-493b-861d-fc03a046a4bd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:24.457894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743acdfe-cb83-4857-8d11-36e25080fe1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:24.458552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743acdfe-cb83-4857-8d11-36e25080fe1b service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:24.458835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743acdfe-cb83-4857-8d11-36e25080fe1b service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:24.459138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743acdfe-cb83-4857-8d11-36e25080fe1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:24.468358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743acdfe-cb83-4857-8d11-36e25080fe1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:24.469813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743acdfe-cb83-4857-8d11-36e25080fe1b service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:24.478835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 622/1242] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:28.914368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87b1ce-4732-40c3-a02c-3e7d1a659a0a None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:28.914893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87b1ce-4732-40c3-a02c-3e7d1a659a0a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:28.914893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87b1ce-4732-40c3-a02c-3e7d1a659a0a None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:28.916645 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 621/1243] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:28.925390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19188f1b-c989-4964-8eb6-d0d85777b1f0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:28.925932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19188f1b-c989-4964-8eb6-d0d85777b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:28.926384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19188f1b-c989-4964-8eb6-d0d85777b1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:28.952329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-19188f1b-c989-4964-8eb6-d0d85777b1f0 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:28.953528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-19188f1b-c989-4964-8eb6-d0d85777b1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:28.960773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 623/1244] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:29.000140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87b1ce-4732-40c3-a02c-3e7d1a659a0a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:29.011960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87b1ce-4732-40c3-a02c-3e7d1a659a0a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:29.015498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f848e-3a24-40af-af2a-8ad0200aa805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:29.016149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f848e-3a24-40af-af2a-8ad0200aa805 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:29.016420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f848e-3a24-40af-af2a-8ad0200aa805 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:29.016691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f848e-3a24-40af-af2a-8ad0200aa805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:29.026145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f848e-3a24-40af-af2a-8ad0200aa805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:29.027699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f848e-3a24-40af-af2a-8ad0200aa805 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:29.037299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 622/1245] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:31.887585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb02064-742d-4578-b80b-9599e073bb7d None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:31.888150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb02064-742d-4578-b80b-9599e073bb7d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:31.888150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb02064-742d-4578-b80b-9599e073bb7d None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:31.889964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 624/1246] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:31.896469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db839a5e-304f-46c1-b9dc-0d60b766ba0a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:31.897519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db839a5e-304f-46c1-b9dc-0d60b766ba0a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:31.897666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db839a5e-304f-46c1-b9dc-0d60b766ba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:31.917798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-db839a5e-304f-46c1-b9dc-0d60b766ba0a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:31.919383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-db839a5e-304f-46c1-b9dc-0d60b766ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:31.930501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 623/1247] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:31.969648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb02064-742d-4578-b80b-9599e073bb7d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:31.971650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-beb02064-742d-4578-b80b-9599e073bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:31.991279 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb02064-742d-4578-b80b-9599e073bb7d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:31.994813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc70fb-31b0-47b2-9d7b-fce476a7d7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:31.995506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc70fb-31b0-47b2-9d7b-fce476a7d7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:31.995793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc70fb-31b0-47b2-9d7b-fce476a7d7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:31.996363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc70fb-31b0-47b2-9d7b-fce476a7d7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:32.007216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc70fb-31b0-47b2-9d7b-fce476a7d7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:32.008701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc70fb-31b0-47b2-9d7b-fce476a7d7d9 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:32.020418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 625/1248] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:36.988387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725058-278e-400b-a724-003a4fb2c2de None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:36.988978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725058-278e-400b-a724-003a4fb2c2de None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:36.988978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725058-278e-400b-a724-003a4fb2c2de None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:36.991405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 624/1249] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:36.998766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d1d92-5a33-4a13-b7b2-cd44deca16e2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:36.999345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d1d92-5a33-4a13-b7b2-cd44deca16e2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:36.999859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d1d92-5a33-4a13-b7b2-cd44deca16e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:37.029130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8c5d1d92-5a33-4a13-b7b2-cd44deca16e2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:37.030661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8c5d1d92-5a33-4a13-b7b2-cd44deca16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:37.041108 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 626/1250] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:37.080772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725058-278e-400b-a724-003a4fb2c2de None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:37.092695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725058-278e-400b-a724-003a4fb2c2de None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:37.096460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e2b97-1773-410d-ab9d-f03ba25a7add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:37.097118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2b97-1773-410d-ab9d-f03ba25a7add service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:37.097488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2b97-1773-410d-ab9d-f03ba25a7add service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:37.097653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2b97-1773-410d-ab9d-f03ba25a7add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:37.108615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e2b97-1773-410d-ab9d-f03ba25a7add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:37.110069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e2b97-1773-410d-ab9d-f03ba25a7add service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:37.120391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 625/1251] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:33:42.197331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ffa4-21b1-494a-aecb-1c90a01fd929 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:42.199080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ffa4-21b1-494a-aecb-1c90a01fd929 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:42.199587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ffa4-21b1-494a-aecb-1c90a01fd929 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:42.202997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 627/1252] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:33:42 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:42.214053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078279e-a3df-421e-84a7-92ca9311e4c6 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:42.219591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078279e-a3df-421e-84a7-92ca9311e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:42.220088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078279e-a3df-421e-84a7-92ca9311e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:42.328852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1078279e-a3df-421e-84a7-92ca9311e4c6 None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:42.330243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1078279e-a3df-421e-84a7-92ca9311e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:42.437634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 626/1253] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:33:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:42.617767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f2a0-50ec-4286-925d-0a25730d6c72 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:42.618528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f2a0-50ec-4286-925d-0a25730d6c72 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:42.619050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f2a0-50ec-4286-925d-0a25730d6c72 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:42.621039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 628/1254] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:33:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:42.626247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78bd1-1a18-44ed-9b76-7a11cae59001 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:42.626540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78bd1-1a18-44ed-9b76-7a11cae59001 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:42.626822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78bd1-1a18-44ed-9b76-7a11cae59001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:42.647552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-fdc78bd1-1a18-44ed-9b76-7a11cae59001 None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:42.648630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fdc78bd1-1a18-44ed-9b76-7a11cae59001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:42.658894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 627/1255] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:33:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:47.119459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad6ee-6016-4866-979d-93ac8f609f26 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:47.120024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad6ee-6016-4866-979d-93ac8f609f26 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:47.120024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad6ee-6016-4866-979d-93ac8f609f26 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:47.129709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 629/1256] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:33:47 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:47.136211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a81b-779e-4623-bad3-6cf762ce24f8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:47.137205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a81b-779e-4623-bad3-6cf762ce24f8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:47.137790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50a81b-779e-4623-bad3-6cf762ce24f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:47.157590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2d50a81b-779e-4623-bad3-6cf762ce24f8 None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:47.158744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2d50a81b-779e-4623-bad3-6cf762ce24f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:47.168743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 628/1257] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:33:47 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:48.799210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f361c8-e122-4bfa-986a-9ba531a646af None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:48.799737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f361c8-e122-4bfa-986a-9ba531a646af None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:48.799832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f361c8-e122-4bfa-986a-9ba531a646af None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:48.801611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 630/1258] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:33:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:48.807081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21099-b7c1-43bb-b166-905c501084da None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:48.807691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21099-b7c1-43bb-b166-905c501084da None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:48.807691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b21099-b7c1-43bb-b166-905c501084da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:48.828219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-17b21099-b7c1-43bb-b166-905c501084da None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:48.829757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-17b21099-b7c1-43bb-b166-905c501084da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:48.838456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 629/1259] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:33:48 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:52.642866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3da65-9fbf-47bc-a2da-b8fd7a75918f None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:52.643441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3da65-9fbf-47bc-a2da-b8fd7a75918f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:52.643672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3da65-9fbf-47bc-a2da-b8fd7a75918f None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:52.645817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 631/1260] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:33:52.651170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d36002-15d6-4002-8026-7783a4aba8dd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:52.651666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d36002-15d6-4002-8026-7783a4aba8dd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:52.651747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d36002-15d6-4002-8026-7783a4aba8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:52.669781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b6d36002-15d6-4002-8026-7783a4aba8dd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:52.671004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b6d36002-15d6-4002-8026-7783a4aba8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:52.679307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 630/1261] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:52.727377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e461001-6b63-4d22-9624-e83dd2395f11 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:52.727897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e461001-6b63-4d22-9624-e83dd2395f11 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:52.728183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e461001-6b63-4d22-9624-e83dd2395f11 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:52.730001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 632/1262] 10.222.0.66 () {54 vars in 961 bytes} [Tue Jul 13 08:33:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:52.735728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356cf4-d286-4788-b712-648fdd83ddce None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:52.736129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356cf4-d286-4788-b712-648fdd83ddce None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:52.736609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356cf4-d286-4788-b712-648fdd83ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:52.783578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-be356cf4-d286-4788-b712-648fdd83ddce None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:52.784878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-be356cf4-d286-4788-b712-648fdd83ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:52.867594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 631/1263] 10.222.0.66 () {58 vars in 1059 bytes} [Tue Jul 13 08:33:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:52.875611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e461001-6b63-4d22-9624-e83dd2395f11 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:52.891949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e461001-6b63-4d22-9624-e83dd2395f11 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:52.897942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67d08d-9a03-4e19-a59b-f1393572048a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:52.898683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67d08d-9a03-4e19-a59b-f1393572048a service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:52.899099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67d08d-9a03-4e19-a59b-f1393572048a service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:52.899539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67d08d-9a03-4e19-a59b-f1393572048a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:52.907559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67d08d-9a03-4e19-a59b-f1393572048a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:52.909250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67d08d-9a03-4e19-a59b-f1393572048a service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:52.918813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 633/1264] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:55.309149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e235d-e411-4522-b5f0-dc4152014670 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:55.309701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e235d-e411-4522-b5f0-dc4152014670 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:55.309701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e235d-e411-4522-b5f0-dc4152014670 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:55.311488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 632/1265] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:55.321078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e4ed-1a88-448d-8f62-b6579bda6dc0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:55.321533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e4ed-1a88-448d-8f62-b6579bda6dc0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:55.321643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e4ed-1a88-448d-8f62-b6579bda6dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:55.338997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6f32e4ed-1a88-448d-8f62-b6579bda6dc0 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:55.340278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6f32e4ed-1a88-448d-8f62-b6579bda6dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:55.347523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 634/1266] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:55.397169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e235d-e411-4522-b5f0-dc4152014670 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:55.412131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e235d-e411-4522-b5f0-dc4152014670 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:55.417982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4480b9-2f90-46ef-8172-0b0d7d16f957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:55.418764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4480b9-2f90-46ef-8172-0b0d7d16f957 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:55.419191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4480b9-2f90-46ef-8172-0b0d7d16f957 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:55.419544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4480b9-2f90-46ef-8172-0b0d7d16f957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:55.429872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4480b9-2f90-46ef-8172-0b0d7d16f957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:55.431851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4480b9-2f90-46ef-8172-0b0d7d16f957 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:55.441674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 633/1267] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:33:57.926603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c185-b58c-4aa4-82d6-bf11960bfb37 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:57.927106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c185-b58c-4aa4-82d6-bf11960bfb37 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:57.927278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78c185-b58c-4aa4-82d6-bf11960bfb37 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:57.929059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 635/1268] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:33:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:57.934592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd080f6-efd0-4dd2-acdb-d272ef03d814 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:57.935121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd080f6-efd0-4dd2-acdb-d272ef03d814 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:57.935213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd080f6-efd0-4dd2-acdb-d272ef03d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:57.953993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2dd080f6-efd0-4dd2-acdb-d272ef03d814 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:57.954668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2dd080f6-efd0-4dd2-acdb-d272ef03d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:57.963091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 634/1269] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:33:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:33:58.009651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33f8c-3756-492b-8d98-15bbd582d2cd None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:58.010041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33f8c-3756-492b-8d98-15bbd582d2cd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:58.010379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33f8c-3756-492b-8d98-15bbd582d2cd None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:58.012993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 636/1270] 10.222.0.66 () {54 vars in 961 bytes} [Tue Jul 13 08:33:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:33:58.018006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01f3c-9ecb-45a1-8bb7-4a6d40c52216 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:58.018353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01f3c-9ecb-45a1-8bb7-4a6d40c52216 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:58.018637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01f3c-9ecb-45a1-8bb7-4a6d40c52216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:58.037347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-faf01f3c-9ecb-45a1-8bb7-4a6d40c52216 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:33:58.038395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-faf01f3c-9ecb-45a1-8bb7-4a6d40c52216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:33:58.047358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 635/1271] 10.222.0.66 () {58 vars in 1059 bytes} [Tue Jul 13 08:33:58 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:33:58.055581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33f8c-3756-492b-8d98-15bbd582d2cd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:33:58.072088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33f8c-3756-492b-8d98-15bbd582d2cd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:33:58.077928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9950c-a262-4a2b-a276-f5db1ed94da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:33:58.078567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9950c-a262-4a2b-a276-f5db1ed94da5 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:33:58.078857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9950c-a262-4a2b-a276-f5db1ed94da5 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:33:58.079181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9950c-a262-4a2b-a276-f5db1ed94da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:33:58.092449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9950c-a262-4a2b-a276-f5db1ed94da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:33:58.092449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9950c-a262-4a2b-a276-f5db1ed94da5 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:33:58.098218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 637/1272] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:33:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:00.340214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e56c-dc8d-446c-a8a8-d00520b0ee21 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:00.340761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e56c-dc8d-446c-a8a8-d00520b0ee21 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:00.340761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e56c-dc8d-446c-a8a8-d00520b0ee21 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:00.342673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 636/1273] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:00.348117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be966b52-bee7-429a-900f-dc24ed7cadeb None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:00.349124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be966b52-bee7-429a-900f-dc24ed7cadeb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:00.349307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be966b52-bee7-429a-900f-dc24ed7cadeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:00.366536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-be966b52-bee7-429a-900f-dc24ed7cadeb None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:00.367751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-be966b52-bee7-429a-900f-dc24ed7cadeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:00.374990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 638/1274] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:00.420205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e56c-dc8d-446c-a8a8-d00520b0ee21 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:00.434353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e56c-dc8d-446c-a8a8-d00520b0ee21 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:00.439945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e0c79-ef2f-477b-92c4-0e93a7dec562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:00.440591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0c79-ef2f-477b-92c4-0e93a7dec562 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:00.442791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0c79-ef2f-477b-92c4-0e93a7dec562 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:00.443140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0c79-ef2f-477b-92c4-0e93a7dec562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:00.451884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e0c79-ef2f-477b-92c4-0e93a7dec562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:00.453607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e0c79-ef2f-477b-92c4-0e93a7dec562 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:00.462842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 637/1275] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:01.283125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558217-ac02-4474-897b-2abafac8622e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:01.283400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558217-ac02-4474-897b-2abafac8622e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:01.283869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558217-ac02-4474-897b-2abafac8622e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:01.285624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 639/1276] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:01.291260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2b34-50b7-4745-8a0d-0595bcee9f8f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:01.291757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2b34-50b7-4745-8a0d-0595bcee9f8f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:01.292191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2b34-50b7-4745-8a0d-0595bcee9f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:01.309938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-063d2b34-50b7-4745-8a0d-0595bcee9f8f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:01.311369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-063d2b34-50b7-4745-8a0d-0595bcee9f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:01.319917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 638/1277] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:01.380948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92793284-fbe1-4142-937a-a6ac73b86acd None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:01.381649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92793284-fbe1-4142-937a-a6ac73b86acd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:01.382205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92793284-fbe1-4142-937a-a6ac73b86acd None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:01.384309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 640/1278] 10.222.0.66 () {54 vars in 963 bytes} [Tue Jul 13 08:34:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:01.389567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603329b-d6d3-40df-8dd8-f666c93ccf9f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:01.389988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603329b-d6d3-40df-8dd8-f666c93ccf9f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:01.390302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603329b-d6d3-40df-8dd8-f666c93ccf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:01.443845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b603329b-d6d3-40df-8dd8-f666c93ccf9f None None] MFA Rules not processed for user `679ea61fafe040cdb5235aae7ff59f81`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:01.445222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b603329b-d6d3-40df-8dd8-f666c93ccf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:01.512166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 639/1279] 10.222.0.66 () {58 vars in 1061 bytes} [Tue Jul 13 08:34:01 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:01.519601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92793284-fbe1-4142-937a-a6ac73b86acd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:01.530049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92793284-fbe1-4142-937a-a6ac73b86acd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:01.533523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0d29-2050-453a-8d65-6ccd282bf003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:01.534422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0d29-2050-453a-8d65-6ccd282bf003 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:01.534815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0d29-2050-453a-8d65-6ccd282bf003 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:01.535266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0d29-2050-453a-8d65-6ccd282bf003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:01.544664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0d29-2050-453a-8d65-6ccd282bf003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:01.546216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0d29-2050-453a-8d65-6ccd282bf003 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:01.555972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 641/1280] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:02.679452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a643-dc51-41a5-899c-a786edee6587 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:02.679452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a643-dc51-41a5-899c-a786edee6587 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:02.679452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9a643-dc51-41a5-899c-a786edee6587 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:02.684586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 640/1281] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:02.685959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47335ac9-7d9d-47f6-9e50-ee43163616ad None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:02.685959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47335ac9-7d9d-47f6-9e50-ee43163616ad None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:02.686418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47335ac9-7d9d-47f6-9e50-ee43163616ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:02.706287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-47335ac9-7d9d-47f6-9e50-ee43163616ad None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:02.707578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-47335ac9-7d9d-47f6-9e50-ee43163616ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:02.716836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 642/1282] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:02.766547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a643-dc51-41a5-899c-a786edee6587 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:02.793811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9a643-dc51-41a5-899c-a786edee6587 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:02.806311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c81f1c-beb8-4686-99a6-2c9dab40abc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:02.807299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81f1c-beb8-4686-99a6-2c9dab40abc4 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:02.807697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81f1c-beb8-4686-99a6-2c9dab40abc4 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:02.808036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81f1c-beb8-4686-99a6-2c9dab40abc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:02.817075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81f1c-beb8-4686-99a6-2c9dab40abc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:02.820100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81f1c-beb8-4686-99a6-2c9dab40abc4 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:02.834137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 641/1283] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:05.055161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8cc6a-95f2-492a-a079-358e29791afa None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:05.055695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8cc6a-95f2-492a-a079-358e29791afa None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:05.055791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8cc6a-95f2-492a-a079-358e29791afa None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:05.059438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 643/1284] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:05.062766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073089b-9be6-4185-b05a-f126b056a771 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:05.063219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073089b-9be6-4185-b05a-f126b056a771 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:05.063384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073089b-9be6-4185-b05a-f126b056a771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:05.083199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5073089b-9be6-4185-b05a-f126b056a771 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:05.084861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5073089b-9be6-4185-b05a-f126b056a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:05.098978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 642/1285] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:05.139644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8cc6a-95f2-492a-a079-358e29791afa None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:05.153929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8cc6a-95f2-492a-a079-358e29791afa None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:05.159115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89dd65-24f5-4de1-81a7-863a2fb218e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:05.159754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89dd65-24f5-4de1-81a7-863a2fb218e9 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:05.160040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89dd65-24f5-4de1-81a7-863a2fb218e9 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:05.160331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89dd65-24f5-4de1-81a7-863a2fb218e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:05.168690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89dd65-24f5-4de1-81a7-863a2fb218e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:05.170273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89dd65-24f5-4de1-81a7-863a2fb218e9 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:05.181118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 644/1286] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:07.397554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effba62f-b8d4-43cf-a012-84fcc245c3e8 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:07.398103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effba62f-b8d4-43cf-a012-84fcc245c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:07.398375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effba62f-b8d4-43cf-a012-84fcc245c3e8 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:07.403248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 643/1287] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:07 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:07.405580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ef50d-7c69-46b7-9232-e5cbbbf12fa8 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:07.405998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ef50d-7c69-46b7-9232-e5cbbbf12fa8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:07.406453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ef50d-7c69-46b7-9232-e5cbbbf12fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:07.424444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-968ef50d-7c69-46b7-9232-e5cbbbf12fa8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:07.425595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-968ef50d-7c69-46b7-9232-e5cbbbf12fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:07.435170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 645/1288] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:07.478602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effba62f-b8d4-43cf-a012-84fcc245c3e8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:07.493983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effba62f-b8d4-43cf-a012-84fcc245c3e8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:07.499982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773970d-e070-4dea-a2b0-a461ea3bf3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:07.500944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773970d-e070-4dea-a2b0-a461ea3bf3d5 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:07.501385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773970d-e070-4dea-a2b0-a461ea3bf3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:07.501917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773970d-e070-4dea-a2b0-a461ea3bf3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:07.512333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773970d-e070-4dea-a2b0-a461ea3bf3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:07.514392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773970d-e070-4dea-a2b0-a461ea3bf3d5 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:07.525461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 644/1289] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:09.948886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fac2-aefa-4407-9896-74f8efc5fcc9 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:09.949563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fac2-aefa-4407-9896-74f8efc5fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:09.949716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fac2-aefa-4407-9896-74f8efc5fcc9 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:09.952155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 646/1290] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:09.959994 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdcafc-cd46-4fa2-b2b1-528b1d5f467a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:09.960485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdcafc-cd46-4fa2-b2b1-528b1d5f467a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:09.960601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdcafc-cd46-4fa2-b2b1-528b1d5f467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:09.981509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e9cdcafc-cd46-4fa2-b2b1-528b1d5f467a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:09.982973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e9cdcafc-cd46-4fa2-b2b1-528b1d5f467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:09.991713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 645/1291] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:34:10.039716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714fac2-aefa-4407-9896-74f8efc5fcc9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:10.058176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714fac2-aefa-4407-9896-74f8efc5fcc9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:10.065390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a479d9-45b4-418e-9434-e1eba6eced3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:10.066221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a479d9-45b4-418e-9434-e1eba6eced3a service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:10.066611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a479d9-45b4-418e-9434-e1eba6eced3a service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:10.067658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a479d9-45b4-418e-9434-e1eba6eced3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:10.078641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a479d9-45b4-418e-9434-e1eba6eced3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:10.080681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a479d9-45b4-418e-9434-e1eba6eced3a service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:10.092300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 647/1292] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:12.281852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82c85-ada0-4958-82b2-fcf7d5e4a4b6 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:12.282419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82c85-ada0-4958-82b2-fcf7d5e4a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:12.282419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82c85-ada0-4958-82b2-fcf7d5e4a4b6 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:12.284231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 646/1293] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:12.290428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d58b7-1dea-4425-8e87-ef6b60169dbd None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:12.291052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d58b7-1dea-4425-8e87-ef6b60169dbd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:12.291052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d58b7-1dea-4425-8e87-ef6b60169dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:12.309706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-295d58b7-1dea-4425-8e87-ef6b60169dbd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:12.310889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-295d58b7-1dea-4425-8e87-ef6b60169dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:12.318800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 648/1294] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:12.364311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd82c85-ada0-4958-82b2-fcf7d5e4a4b6 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:12.378188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd82c85-ada0-4958-82b2-fcf7d5e4a4b6 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:12.383798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2707ab-3a80-438b-ad6b-39cbbb6bd7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:12.384461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2707ab-3a80-438b-ad6b-39cbbb6bd7d3 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:12.384742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2707ab-3a80-438b-ad6b-39cbbb6bd7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:12.385024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2707ab-3a80-438b-ad6b-39cbbb6bd7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:12.393495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2707ab-3a80-438b-ad6b-39cbbb6bd7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:12.395706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2707ab-3a80-438b-ad6b-39cbbb6bd7d3 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:12.405107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 647/1295] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:14.564322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f53f-bb37-4d84-ad14-9b517d0adb2a None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:14.564894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f53f-bb37-4d84-ad14-9b517d0adb2a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:14.564894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7f53f-bb37-4d84-ad14-9b517d0adb2a None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:14.567224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 649/1296] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:14.572423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530ca2a-6e02-4e3c-a934-45111e2a5485 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:14.572898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530ca2a-6e02-4e3c-a934-45111e2a5485 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:14.573003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530ca2a-6e02-4e3c-a934-45111e2a5485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:14.590443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a530ca2a-6e02-4e3c-a934-45111e2a5485 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:14.591599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a530ca2a-6e02-4e3c-a934-45111e2a5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:14.598885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 648/1297] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:14.642695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f53f-bb37-4d84-ad14-9b517d0adb2a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:14.656291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7f53f-bb37-4d84-ad14-9b517d0adb2a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:14.661811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849f52-1997-4616-8e43-2ab01f5fb09d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:14.662446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849f52-1997-4616-8e43-2ab01f5fb09d service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:14.662730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849f52-1997-4616-8e43-2ab01f5fb09d service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:14.663043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849f52-1997-4616-8e43-2ab01f5fb09d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:14.670822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849f52-1997-4616-8e43-2ab01f5fb09d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:14.672487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849f52-1997-4616-8e43-2ab01f5fb09d service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:14.682110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 650/1298] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:16.191936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60918f-e6b8-49a8-aad5-c63d5b6aea8b None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.192536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60918f-e6b8-49a8-aad5-c63d5b6aea8b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.192536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60918f-e6b8-49a8-aad5-c63d5b6aea8b None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.194070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 649/1299] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:16.199572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94317d8b-2cb3-4306-83c2-3787bf1c2705 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.199997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94317d8b-2cb3-4306-83c2-3787bf1c2705 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.200152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94317d8b-2cb3-4306-83c2-3787bf1c2705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.217699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-94317d8b-2cb3-4306-83c2-3787bf1c2705 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:16.218841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-94317d8b-2cb3-4306-83c2-3787bf1c2705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:16.226602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 651/1300] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:16.282779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376223-d443-43d8-ac37-42a0a7dc11de None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.283122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376223-d443-43d8-ac37-42a0a7dc11de None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.283407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376223-d443-43d8-ac37-42a0a7dc11de None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.285857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 650/1301] 10.222.0.66 () {54 vars in 962 bytes} [Tue Jul 13 08:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:16.291171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26b80-f8eb-4a1e-a2fe-621fa4ab3d1b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.291463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26b80-f8eb-4a1e-a2fe-621fa4ab3d1b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.291742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26b80-f8eb-4a1e-a2fe-621fa4ab3d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.339239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5db26b80-f8eb-4a1e-a2fe-621fa4ab3d1b None None] MFA Rules not processed for user `c2227b93e13c4a418b506b2a2c011c76`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:16.340389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5db26b80-f8eb-4a1e-a2fe-621fa4ab3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:16.399875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 652/1302] 10.222.0.66 () {58 vars in 1060 bytes} [Tue Jul 13 08:34:16 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:16.407367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c376223-d443-43d8-ac37-42a0a7dc11de None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:16.418051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c376223-d443-43d8-ac37-42a0a7dc11de None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:16.421396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b963b3-bfc3-4da0-861b-dcf79cbcea12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:16.422113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b963b3-bfc3-4da0-861b-dcf79cbcea12 service glance] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.422395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b963b3-bfc3-4da0-861b-dcf79cbcea12 service glance] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.422664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b963b3-bfc3-4da0-861b-dcf79cbcea12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.431265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b963b3-bfc3-4da0-861b-dcf79cbcea12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:16.432686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b963b3-bfc3-4da0-861b-dcf79cbcea12 service glance] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:16.441142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 651/1303] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:34:16.862899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17715faa-7de9-46c8-8ea7-e75a966f16d9 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.863795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17715faa-7de9-46c8-8ea7-e75a966f16d9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.864198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17715faa-7de9-46c8-8ea7-e75a966f16d9 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.866305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 653/1304] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:16.871785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.872074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.872379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.891440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:16.891626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826b49a-d1c8-410a-ab50-6bc3768ce995 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.891763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826b49a-d1c8-410a-ab50-6bc3768ce995 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.892038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826b49a-d1c8-410a-ab50-6bc3768ce995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.892604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:16.900406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 652/1305] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:16.941247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6826b49a-d1c8-410a-ab50-6bc3768ce995 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:16.943572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6826b49a-d1c8-410a-ab50-6bc3768ce995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:16.946212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:16.957052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33a57-6815-4de9-9372-cf06d770d0c8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:16.962294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076f329-10bf-4f45-aab5-632c62b8f69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:16.962957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076f329-10bf-4f45-aab5-632c62b8f69b service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:16.963298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076f329-10bf-4f45-aab5-632c62b8f69b service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:16.963519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076f329-10bf-4f45-aab5-632c62b8f69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:16.971276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076f329-10bf-4f45-aab5-632c62b8f69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:16.972867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076f329-10bf-4f45-aab5-632c62b8f69b service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:16.981837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 653/1306] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:34:17.007882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 654/1307] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:34:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:34:17.055411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288dd92-de59-445c-96f1-de8123838741 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:17.055791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288dd92-de59-445c-96f1-de8123838741 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:17.056157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288dd92-de59-445c-96f1-de8123838741 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:17.058116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 654/1308] 10.222.0.66 () {54 vars in 942 bytes} [Tue Jul 13 08:34:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:17.067088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3638f-7fd7-475b-879c-535b9f05c460 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:17.068020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3638f-7fd7-475b-879c-535b9f05c460 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:17.068232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3638f-7fd7-475b-879c-535b9f05c460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:17.124776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-60f3638f-7fd7-475b-879c-535b9f05c460 None None] MFA Rules not processed for user `2bd1472455034b3884be9c92d21c591f`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:17.125970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-60f3638f-7fd7-475b-879c-535b9f05c460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:17.205009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 655/1309] 10.222.0.66 () {58 vars in 1040 bytes} [Tue Jul 13 08:34:17 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:17.218203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288dd92-de59-445c-96f1-de8123838741 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:17.232903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288dd92-de59-445c-96f1-de8123838741 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:17.239108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c8105-e576-4141-ab88-da48c6818c75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:17.240001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c8105-e576-4141-ab88-da48c6818c75 service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:17.240544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c8105-e576-4141-ab88-da48c6818c75 service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:17.241029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c8105-e576-4141-ab88-da48c6818c75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:17.251716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c8105-e576-4141-ab88-da48c6818c75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:17.253362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c8105-e576-4141-ab88-da48c6818c75 service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:17.261381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 655/1310] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:34:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:34:19.213847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022f4e-df6a-4d1f-932b-45b36f508ce7 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:19.214504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022f4e-df6a-4d1f-932b-45b36f508ce7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:19.214953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022f4e-df6a-4d1f-932b-45b36f508ce7 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:19.221234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 656/1311] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:19 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:34:19.226935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3e96-cb7b-436e-b7bb-9b3bcb6d9a12 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:19.227414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3e96-cb7b-436e-b7bb-9b3bcb6d9a12 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:19.227503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3e96-cb7b-436e-b7bb-9b3bcb6d9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:19.245935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b04f3e96-cb7b-436e-b7bb-9b3bcb6d9a12 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:19.247127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b04f3e96-cb7b-436e-b7bb-9b3bcb6d9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:19.263447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 656/1312] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:19.302567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022f4e-df6a-4d1f-932b-45b36f508ce7 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:19.319161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022f4e-df6a-4d1f-932b-45b36f508ce7 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:19.324336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebf2a3-e4e9-4b8e-bd27-566e29f2080e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:19.325060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebf2a3-e4e9-4b8e-bd27-566e29f2080e service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:19.325348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebf2a3-e4e9-4b8e-bd27-566e29f2080e service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:19.325623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebf2a3-e4e9-4b8e-bd27-566e29f2080e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:19.337704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebf2a3-e4e9-4b8e-bd27-566e29f2080e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:19.339382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebf2a3-e4e9-4b8e-bd27-566e29f2080e service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:19.348732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 657/1313] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:34:34.421263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5813e-ca3c-4c0e-975e-e0072ed12902 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:34.421828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5813e-ca3c-4c0e-975e-e0072ed12902 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:34.421828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5813e-ca3c-4c0e-975e-e0072ed12902 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:34.423634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 657/1314] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:34.429820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c3e7-83bc-4348-96a3-542bc17daea4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:34.430300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c3e7-83bc-4348-96a3-542bc17daea4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:34.430411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c3e7-83bc-4348-96a3-542bc17daea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:34.448662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3184c3e7-83bc-4348-96a3-542bc17daea4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:34.449837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3184c3e7-83bc-4348-96a3-542bc17daea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:34.457749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 658/1315] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:34.483606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5813e-ca3c-4c0e-975e-e0072ed12902 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:34.496723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5813e-ca3c-4c0e-975e-e0072ed12902 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:34.502395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91688991-95a7-4464-a6b1-06cf95e342f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:34.503688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91688991-95a7-4464-a6b1-06cf95e342f0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:34.504011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91688991-95a7-4464-a6b1-06cf95e342f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:34.504316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91688991-95a7-4464-a6b1-06cf95e342f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:34.505108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91688991-95a7-4464-a6b1-06cf95e342f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:34.506987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91688991-95a7-4464-a6b1-06cf95e342f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:34.522384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 658/1316] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:34:34 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:34:36.677780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900980a2-b0b0-463a-89fb-a8c2edce0714 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:36.678629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900980a2-b0b0-463a-89fb-a8c2edce0714 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:36.678809 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900980a2-b0b0-463a-89fb-a8c2edce0714 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:36.680660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 659/1317] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:36.687098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:36.687636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:36.687741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:36.706648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:36.708026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:36.715227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 659/1318] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:36.739914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900980a2-b0b0-463a-89fb-a8c2edce0714 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:36.751776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900980a2-b0b0-463a-89fb-a8c2edce0714 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:36.757074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:36.757941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:36.758221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:36.758504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] PATH_INFO: `/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:36.770458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] RBAC: Authorizing `identity:get_project(project_id=0a742d49a1a0413086992eb4fb7cd3d8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:36.772577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:36.774333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 660/1319] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:36 2021] GET /identity/v3/projects/0a742d49a1a0413086992eb4fb7cd3d8 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:36.780748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:36.790136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810014f-d81b-49c4-81d7-e1f90bea8f0a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:36.794404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:36.795092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:36.795378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:36.795652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:36.796421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] RBAC: Adding query filter params (scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:36.796728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:36.798609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:36.811985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 660/1320] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:36 2021] GET /identity/v3/role_assignments?scope.project.id=0a742d49a1a0413086992eb4fb7cd3d8 => generated 1934 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:34:36.819233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:36.828697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaef38-2c28-47e5-bcff-8b2f5f6daaea admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:36.833757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f857f-f4b8-4a84-9bc3-9021c78e6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:36.834636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f857f-f4b8-4a84-9bc3-9021c78e6470 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:36.834938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f857f-f4b8-4a84-9bc3-9021c78e6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:36.835227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f857f-f4b8-4a84-9bc3-9021c78e6470 admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:36.836544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f857f-f4b8-4a84-9bc3-9021c78e6470 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:36.838682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f857f-f4b8-4a84-9bc3-9021c78e6470 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:36.840454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 661/1321] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:36 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:36.846616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:36.856190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ea60-41e4-45f6-84f7-9b821472b117 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:36.860608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ee80-6791-44a3-838a-845946fc6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:36.861475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ee80-6791-44a3-838a-845946fc6c05 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:36.861764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ee80-6791-44a3-838a-845946fc6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:36.862052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ee80-6791-44a3-838a-845946fc6c05 admin admin] PATH_INFO: `/v3/users/051cb93831e34e3c87b2534dee3827b6` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:36.876551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ee80-6791-44a3-838a-845946fc6c05 admin admin] RBAC: Authorizing `identity:get_user(user_id=051cb93831e34e3c87b2534dee3827b6)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:36.879764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ee80-6791-44a3-838a-845946fc6c05 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:36.881531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 661/1322] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:36 2021] GET /identity/v3/users/051cb93831e34e3c87b2534dee3827b6 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:39.157226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b54dc3-37b4-4f97-9494-2cc0e273e6a8 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:39.157958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b54dc3-37b4-4f97-9494-2cc0e273e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:39.157958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b54dc3-37b4-4f97-9494-2cc0e273e6a8 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:39.160337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 662/1323] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:34:39.166194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:39.166756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:39.166756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:39.185488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:39.186684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:39.194671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 662/1324] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:34:39.219698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b54dc3-37b4-4f97-9494-2cc0e273e6a8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:39.233658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b54dc3-37b4-4f97-9494-2cc0e273e6a8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:39.239493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:39.240396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:39.240680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:39.240960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] PATH_INFO: `/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:39.242302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] RBAC: Authorizing `identity:get_project(project_id=25cc3ad984ea4044b5e9444df5ff7faf)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:39.244208 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:39.246288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 663/1325] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:39 2021] GET /identity/v3/projects/25cc3ad984ea4044b5e9444df5ff7faf => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:39.252386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:39.262301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201481-4039-4937-9fca-b452a1c1a65d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:39.266842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:39.267552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:39.267833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:39.268104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:39.269695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] RBAC: Adding query filter params (scope.project.id=25cc3ad984ea4044b5e9444df5ff7faf) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:39.270070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:39.271986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047434a-caad-46da-ad79-3f0636cc7c46 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:39.278964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 663/1326] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:39 2021] GET /identity/v3/role_assignments?scope.project.id=25cc3ad984ea4044b5e9444df5ff7faf => generated 879 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:39.286827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:39.304971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5e29-1c3f-45c0-bcdc-a4b3a1f60686 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:39.312401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a3e93-3753-4f9d-ad37-780c48ec69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:39.313987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3e93-3753-4f9d-ad37-780c48ec69ff admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:39.314510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3e93-3753-4f9d-ad37-780c48ec69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:39.315084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a3e93-3753-4f9d-ad37-780c48ec69ff admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:39.317790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a3e93-3753-4f9d-ad37-780c48ec69ff admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:39.321294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a3e93-3753-4f9d-ad37-780c48ec69ff admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:39.324337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 664/1327] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:39 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:41.589241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05000e-b915-43ce-bc20-650062c2a850 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:41.589800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05000e-b915-43ce-bc20-650062c2a850 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:41.589800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05000e-b915-43ce-bc20-650062c2a850 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:41.591789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 664/1328] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:41.598344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7096-7080-4881-9466-f7bebeac654a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:41.598865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7096-7080-4881-9466-f7bebeac654a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:41.598865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7096-7080-4881-9466-f7bebeac654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:41.617108 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-190b7096-7080-4881-9466-f7bebeac654a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:41.618305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-190b7096-7080-4881-9466-f7bebeac654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:41.625884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 665/1329] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:41.650644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05000e-b915-43ce-bc20-650062c2a850 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:41.663311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05000e-b915-43ce-bc20-650062c2a850 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:41.667529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:41.668380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:41.668660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:41.668933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] PATH_INFO: `/v3/projects/2da821f739c1498c94b24dfad1cb2b52` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:41.680688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2da821f739c1498c94b24dfad1cb2b52)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:41.682895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:41.684689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 665/1330] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:41 2021] GET /identity/v3/projects/2da821f739c1498c94b24dfad1cb2b52 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:41.691795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b7096-7080-4881-9466-f7bebeac654a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:41.700348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b7096-7080-4881-9466-f7bebeac654a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:41.704800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:41.705444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:41.706271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:41.706683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:41.707585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] RBAC: Adding query filter params (scope.project.id=2da821f739c1498c94b24dfad1cb2b52) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:41.707888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:41.709737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e7ce-f2a1-4d02-974f-864d2a09ec2c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:41.716709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 666/1331] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:41 2021] GET /identity/v3/role_assignments?scope.project.id=2da821f739c1498c94b24dfad1cb2b52 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:41.723827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:41.733088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69c30-6102-406f-80de-3b0c8ea5ffb1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:41.738450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7f861-0212-4887-a34e-24526abc8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:41.739378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7f861-0212-4887-a34e-24526abc8b3f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:41.739659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7f861-0212-4887-a34e-24526abc8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:41.739943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7f861-0212-4887-a34e-24526abc8b3f admin admin] PATH_INFO: `/v3/users/1f47f81524f74292a8dacdaaf3d3f874` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:41.754378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7f861-0212-4887-a34e-24526abc8b3f admin admin] RBAC: Authorizing `identity:get_user(user_id=1f47f81524f74292a8dacdaaf3d3f874)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:41.756579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7f861-0212-4887-a34e-24526abc8b3f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:41.758312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 666/1332] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:41 2021] GET /identity/v3/users/1f47f81524f74292a8dacdaaf3d3f874 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:43.998998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e600-abc9-4d6a-8132-6391b0ae8b35 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:43.999591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e600-abc9-4d6a-8132-6391b0ae8b35 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:43.999686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e600-abc9-4d6a-8132-6391b0ae8b35 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:44.001545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 667/1333] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:44.008218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:44.008756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:44.008756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:44.026080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:44.027274 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:44.034892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 667/1334] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:44.059186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42e600-abc9-4d6a-8132-6391b0ae8b35 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:44.072050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42e600-abc9-4d6a-8132-6391b0ae8b35 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:44.076550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:44.077402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:44.077682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:44.077961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] PATH_INFO: `/v3/projects/58c7199938d943d7a31ec342ea304e39` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:44.089921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] RBAC: Authorizing `identity:get_project(project_id=58c7199938d943d7a31ec342ea304e39)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:44.092059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:44.093761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 668/1335] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:44 2021] GET /identity/v3/projects/58c7199938d943d7a31ec342ea304e39 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:44.100156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:44.108633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16102c-8b46-405a-9bea-d5d39a75ef65 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:44.114094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:44.114744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:44.115063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:44.115337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:44.116099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] RBAC: Adding query filter params (scope.project.id=58c7199938d943d7a31ec342ea304e39) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:44.116408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:44.118277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:44.125278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 668/1336] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:44 2021] GET /identity/v3/role_assignments?scope.project.id=58c7199938d943d7a31ec342ea304e39 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:34:44.132112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:44.141807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2458c-497b-4421-8571-4e40b64cec3e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:44.146729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82ecd4-d70e-4826-a72c-3d531080d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:44.147642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ecd4-d70e-4826-a72c-3d531080d22f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:44.147922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ecd4-d70e-4826-a72c-3d531080d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:44.148187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ecd4-d70e-4826-a72c-3d531080d22f admin admin] PATH_INFO: `/v3/users/fe1a2ced475c48049c83dfdc6c90aecc` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:44.149350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82ecd4-d70e-4826-a72c-3d531080d22f admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1a2ced475c48049c83dfdc6c90aecc)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:44.151383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82ecd4-d70e-4826-a72c-3d531080d22f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:44.152957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 669/1337] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:44 2021] GET /identity/v3/users/fe1a2ced475c48049c83dfdc6c90aecc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:44.158938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:44.168316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cf32a-2540-46d1-b16e-d747796c4105 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:44.172737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eb764-a217-4bd5-8d26-e9f8495f7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:44.173603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eb764-a217-4bd5-8d26-e9f8495f7d7f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:44.173888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eb764-a217-4bd5-8d26-e9f8495f7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:44.174172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eb764-a217-4bd5-8d26-e9f8495f7d7f admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:44.188962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eb764-a217-4bd5-8d26-e9f8495f7d7f admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:44.192306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eb764-a217-4bd5-8d26-e9f8495f7d7f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:44.194096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 669/1338] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:44 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:46.454419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9524b-b29e-41ec-b45c-272eb2684ad8 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:46.455023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9524b-b29e-41ec-b45c-272eb2684ad8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:46.455023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9524b-b29e-41ec-b45c-272eb2684ad8 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:46.457448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 670/1339] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:46.462689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:46.463160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:46.463263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:46.479747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:46.480915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:46.488007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 670/1340] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:46.512560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9524b-b29e-41ec-b45c-272eb2684ad8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:46.524677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9524b-b29e-41ec-b45c-272eb2684ad8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:46.528865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:46.529707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:46.529992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:46.530267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] PATH_INFO: `/v3/projects/a66f8c5a14ca4f92860217a228c3a825` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:46.540632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a66f8c5a14ca4f92860217a228c3a825)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:46.542699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:46.544388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 671/1341] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:46 2021] GET /identity/v3/projects/a66f8c5a14ca4f92860217a228c3a825 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:46.551059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:46.559409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d238cc5-d599-4429-ab10-d4859d581abf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:46.563639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:46.564271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:46.564550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:46.565331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:46.566133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] RBAC: Adding query filter params (scope.project.id=a66f8c5a14ca4f92860217a228c3a825) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:46.566435 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:46.568320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc562-6bce-451d-aa85-696d764e72cc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:46.573641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 671/1342] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:46 2021] GET /identity/v3/role_assignments?scope.project.id=a66f8c5a14ca4f92860217a228c3a825 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:46.579293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:46.589033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b28ce-dc7c-4ccd-b96a-347272b4abf8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:46.593325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6fdc3-98f7-42d9-8c80-50a0b0f5b3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:46.594177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6fdc3-98f7-42d9-8c80-50a0b0f5b3cd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:46.594457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6fdc3-98f7-42d9-8c80-50a0b0f5b3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:46.594732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6fdc3-98f7-42d9-8c80-50a0b0f5b3cd admin admin] PATH_INFO: `/v3/users/185aae3d3ca24853b301af03d83f7546` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:46.595894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6fdc3-98f7-42d9-8c80-50a0b0f5b3cd admin admin] RBAC: Authorizing `identity:get_user(user_id=185aae3d3ca24853b301af03d83f7546)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:46.598432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6fdc3-98f7-42d9-8c80-50a0b0f5b3cd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:46.599996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 672/1343] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:46 2021] GET /identity/v3/users/185aae3d3ca24853b301af03d83f7546 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:48.791782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321ee72-025a-464d-b67e-ddacf3a7087e None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:48.792343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321ee72-025a-464d-b67e-ddacf3a7087e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:48.792343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321ee72-025a-464d-b67e-ddacf3a7087e None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:48.794123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 672/1344] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:48.799897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:48.800286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:48.800455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:48.818202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:48.819395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:48.826634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 673/1345] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:48.850492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321ee72-025a-464d-b67e-ddacf3a7087e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:48.862789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321ee72-025a-464d-b67e-ddacf3a7087e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:48.867505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:48.868368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:48.868644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:48.868915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] PATH_INFO: `/v3/projects/dd139877339d4595b277c7c578e05223` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:48.881022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] RBAC: Authorizing `identity:get_project(project_id=dd139877339d4595b277c7c578e05223)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:48.883166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:48.886123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 673/1346] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:48 2021] GET /identity/v3/projects/dd139877339d4595b277c7c578e05223 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:48.891316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:48.900161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaf720-d928-4915-8639-fcbea5db069c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:48.904506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:48.905147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:48.905431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:48.905708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:48.906547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] RBAC: Adding query filter params (scope.project.id=dd139877339d4595b277c7c578e05223) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:48.906807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:48.909381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:48.915486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 674/1347] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:48 2021] GET /identity/v3/role_assignments?scope.project.id=dd139877339d4595b277c7c578e05223 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:48.921319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:48.931060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72675-6d30-4264-8f47-793566a18ecb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:48.935450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ed39-f95a-4216-9847-5bd61a9f1bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:48.936297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ed39-f95a-4216-9847-5bd61a9f1bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:48.936578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ed39-f95a-4216-9847-5bd61a9f1bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:48.936852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ed39-f95a-4216-9847-5bd61a9f1bf5 admin admin] PATH_INFO: `/v3/users/2f8c73acbd314ab09a1c6151154657e0` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:48.950346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ed39-f95a-4216-9847-5bd61a9f1bf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=2f8c73acbd314ab09a1c6151154657e0)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:48.952512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ed39-f95a-4216-9847-5bd61a9f1bf5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:48.954116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 674/1348] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:48 2021] GET /identity/v3/users/2f8c73acbd314ab09a1c6151154657e0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:48.960079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:48.969080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e1241-dd31-4f5e-9b01-260bc884e3b3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:48.975185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf82f6f-665a-4074-b8b6-3f129886175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:48.976040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82f6f-665a-4074-b8b6-3f129886175d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:48.976361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82f6f-665a-4074-b8b6-3f129886175d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:48.976613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82f6f-665a-4074-b8b6-3f129886175d admin admin] PATH_INFO: `/v3/users/d6e9565c9d8d442b998a070af51e7a03` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:48.990639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf82f6f-665a-4074-b8b6-3f129886175d admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e9565c9d8d442b998a070af51e7a03)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:48.992802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf82f6f-665a-4074-b8b6-3f129886175d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:48.994387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 675/1349] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:48 2021] GET /identity/v3/users/d6e9565c9d8d442b998a070af51e7a03 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:51.238726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2339-7bb2-4195-88da-6cc2433cf217 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:51.239390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2339-7bb2-4195-88da-6cc2433cf217 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:51.239390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2339-7bb2-4195-88da-6cc2433cf217 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:51.241332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 675/1350] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:51.246806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:51.247320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:51.247426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:51.264515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:51.265667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:51.273004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 676/1351] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:34:51.297548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2339-7bb2-4195-88da-6cc2433cf217 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:51.310248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e2339-7bb2-4195-88da-6cc2433cf217 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:51.314540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:51.315932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:51.316217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:51.316491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] PATH_INFO: `/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:51.327200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] RBAC: Authorizing `identity:get_project(project_id=e97a5cd07f5b45a4ba5edf08aa370dbd)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:51.329196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:51.331537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 676/1352] 10.222.0.66 () {56 vars in 1208 bytes} [Tue Jul 13 08:34:51 2021] GET /identity/v3/projects/e97a5cd07f5b45a4ba5edf08aa370dbd => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:51.338189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:51.347765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac161e-a40f-4232-8775-cfe11274e007 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:51.352140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:51.352794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:51.353103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:51.353377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:51.354146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] RBAC: Adding query filter params (scope.project.id=e97a5cd07f5b45a4ba5edf08aa370dbd) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:34:51.354447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:51.356695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1cba8-731e-4bd2-aec7-9098a660367b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:51.362644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 677/1353] 10.222.0.66 () {56 vars in 1232 bytes} [Tue Jul 13 08:34:51 2021] GET /identity/v3/role_assignments?scope.project.id=e97a5cd07f5b45a4ba5edf08aa370dbd => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:51.368593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:51.377888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b563-de12-4dfe-a5e6-c7509e3b80cf admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:51.382284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0644-b289-4520-b428-20f9a4256359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:51.383201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0644-b289-4520-b428-20f9a4256359 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:51.383544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0644-b289-4520-b428-20f9a4256359 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:51.383767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0644-b289-4520-b428-20f9a4256359 admin admin] PATH_INFO: `/v3/users/82e09095234b46289147a8eb49063172` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:51.398939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a0644-b289-4520-b428-20f9a4256359 admin admin] RBAC: Authorizing `identity:get_user(user_id=82e09095234b46289147a8eb49063172)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:51.401097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a0644-b289-4520-b428-20f9a4256359 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:51.402762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 677/1354] 10.222.0.66 () {56 vars in 1199 bytes} [Tue Jul 13 08:34:51 2021] GET /identity/v3/users/82e09095234b46289147a8eb49063172 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:34:56.777217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d1cfa-45ca-4039-b4f6-bdbf7d370876 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:56.777784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d1cfa-45ca-4039-b4f6-bdbf7d370876 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:56.777784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d1cfa-45ca-4039-b4f6-bdbf7d370876 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:56.779556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 678/1355] 10.222.0.66 () {54 vars in 918 bytes} [Tue Jul 13 08:34:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:56.786037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dacf6-02b8-46f7-9276-2e99556b6ed2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:56.786465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dacf6-02b8-46f7-9276-2e99556b6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:56.786565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dacf6-02b8-46f7-9276-2e99556b6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:56.803448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-287dacf6-02b8-46f7-9276-2e99556b6ed2 None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:56.804608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-287dacf6-02b8-46f7-9276-2e99556b6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:56.812822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 678/1356] 10.222.0.66 () {58 vars in 1016 bytes} [Tue Jul 13 08:34:56 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:56.827728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43378a4-c056-41a9-91cc-c7f8d8f2a22f None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:56.828013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43378a4-c056-41a9-91cc-c7f8d8f2a22f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:56.828281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43378a4-c056-41a9-91cc-c7f8d8f2a22f None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:56.830535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 679/1357] 10.222.0.66 () {54 vars in 918 bytes} [Tue Jul 13 08:34:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:56.835288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9818b8-fb3c-45bf-b926-168ce76feaa4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:56.835572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9818b8-fb3c-45bf-b926-168ce76feaa4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:56.835847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9818b8-fb3c-45bf-b926-168ce76feaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:56.853595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2c9818b8-fb3c-45bf-b926-168ce76feaa4 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:56.854728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2c9818b8-fb3c-45bf-b926-168ce76feaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:56.863114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 679/1358] 10.222.0.66 () {58 vars in 1016 bytes} [Tue Jul 13 08:34:56 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:59.667611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebbc77-3142-437b-bca3-0be708eb8529 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:59.668207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebbc77-3142-437b-bca3-0be708eb8529 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:59.668207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebbc77-3142-437b-bca3-0be708eb8529 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:59.669889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 680/1359] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:34:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:34:59.675140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27dbda-2037-4810-8e34-93817238eff0 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:59.675623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27dbda-2037-4810-8e34-93817238eff0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:59.675727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27dbda-2037-4810-8e34-93817238eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:59.692763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2f27dbda-2037-4810-8e34-93817238eff0 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:34:59.693924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2f27dbda-2037-4810-8e34-93817238eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:34:59.701080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 680/1360] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:34:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:34:59.744247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebbc77-3142-437b-bca3-0be708eb8529 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:34:59.757364 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebbc77-3142-437b-bca3-0be708eb8529 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:34:59.762489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23699f2a-88d5-46a7-b101-8726c802500e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:34:59.763177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23699f2a-88d5-46a7-b101-8726c802500e service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:34:59.763456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23699f2a-88d5-46a7-b101-8726c802500e service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:34:59.763726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23699f2a-88d5-46a7-b101-8726c802500e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:34:59.771673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23699f2a-88d5-46a7-b101-8726c802500e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:34:59.773242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23699f2a-88d5-46a7-b101-8726c802500e service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:34:59.782192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 681/1361] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:34:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:01.181765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6785f-4cf4-48e5-aae3-46400fed15c7 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:01.182347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6785f-4cf4-48e5-aae3-46400fed15c7 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:01.182347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6785f-4cf4-48e5-aae3-46400fed15c7 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:01.184340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 681/1362] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:01.190170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2b827-12ea-4cf8-a43c-f51dc66a4e81 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:01.190621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2b827-12ea-4cf8-a43c-f51dc66a4e81 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:01.190721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2b827-12ea-4cf8-a43c-f51dc66a4e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:01.207794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4ce2b827-12ea-4cf8-a43c-f51dc66a4e81 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:01.208954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4ce2b827-12ea-4cf8-a43c-f51dc66a4e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:01.216142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 682/1363] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:01.368833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6785f-4cf4-48e5-aae3-46400fed15c7 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:01.382406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6785f-4cf4-48e5-aae3-46400fed15c7 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:01.387704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ad68b-6994-4ad1-be60-04ae67c7fc3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:01.388324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ad68b-6994-4ad1-be60-04ae67c7fc3b service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:01.388604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ad68b-6994-4ad1-be60-04ae67c7fc3b service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:01.388877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ad68b-6994-4ad1-be60-04ae67c7fc3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:01.397145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ad68b-6994-4ad1-be60-04ae67c7fc3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:01.398727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ad68b-6994-4ad1-be60-04ae67c7fc3b service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:01.407290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 682/1364] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:02.804557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf152-b354-42e2-8697-cfa6a7f05da9 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:02.805122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf152-b354-42e2-8697-cfa6a7f05da9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:02.805122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf152-b354-42e2-8697-cfa6a7f05da9 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:02.807212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 683/1365] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:02.812562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368392ed-e97f-4556-bf82-d6b2e12fadd6 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:02.812992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368392ed-e97f-4556-bf82-d6b2e12fadd6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:02.813117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368392ed-e97f-4556-bf82-d6b2e12fadd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:02.830545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-368392ed-e97f-4556-bf82-d6b2e12fadd6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:02.831737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-368392ed-e97f-4556-bf82-d6b2e12fadd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:02.838843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 683/1366] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:35:02.992634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf152-b354-42e2-8697-cfa6a7f05da9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:03.006305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf152-b354-42e2-8697-cfa6a7f05da9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:03.011626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97790d-d96d-41cc-af7d-94deb8de39df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:03.012262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97790d-d96d-41cc-af7d-94deb8de39df service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:03.012543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97790d-d96d-41cc-af7d-94deb8de39df service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:03.012815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97790d-d96d-41cc-af7d-94deb8de39df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:03.020797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97790d-d96d-41cc-af7d-94deb8de39df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:03.022435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97790d-d96d-41cc-af7d-94deb8de39df service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:03.031071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 684/1367] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:04.409139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1aa3-ce5e-4f7c-a15e-108dd44d31df None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:04.409668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1aa3-ce5e-4f7c-a15e-108dd44d31df None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:04.409668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1aa3-ce5e-4f7c-a15e-108dd44d31df None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:04.411482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 684/1368] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:04.416347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e3d2d-408a-4dd6-80e9-aa3e54fdc547 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:04.416781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e3d2d-408a-4dd6-80e9-aa3e54fdc547 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:04.416885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e3d2d-408a-4dd6-80e9-aa3e54fdc547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:04.435355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b12e3d2d-408a-4dd6-80e9-aa3e54fdc547 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:04.436496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b12e3d2d-408a-4dd6-80e9-aa3e54fdc547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:04.444318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 685/1369] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:35:04.594691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1aa3-ce5e-4f7c-a15e-108dd44d31df None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:04.608160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1aa3-ce5e-4f7c-a15e-108dd44d31df None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:04.613687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40ea84-02d2-49ed-99d5-334d3030fe9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:04.614308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ea84-02d2-49ed-99d5-334d3030fe9f service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:04.614585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ea84-02d2-49ed-99d5-334d3030fe9f service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:04.614855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ea84-02d2-49ed-99d5-334d3030fe9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:04.622455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40ea84-02d2-49ed-99d5-334d3030fe9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:04.624102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40ea84-02d2-49ed-99d5-334d3030fe9f service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:04.633205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 685/1370] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:06.004323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acdb7c-5991-49c2-b9ab-29caa5c345e1 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:06.004884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acdb7c-5991-49c2-b9ab-29caa5c345e1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:06.004884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acdb7c-5991-49c2-b9ab-29caa5c345e1 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:06.006615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 686/1371] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:06.011923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ef34-4534-4843-b8e1-b3d41225a49b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:06.012341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ef34-4534-4843-b8e1-b3d41225a49b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:06.012488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ef34-4534-4843-b8e1-b3d41225a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:06.029979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4d30ef34-4534-4843-b8e1-b3d41225a49b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:06.031169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4d30ef34-4534-4843-b8e1-b3d41225a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:06.038381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 686/1372] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:06.188577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acdb7c-5991-49c2-b9ab-29caa5c345e1 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:06.202350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acdb7c-5991-49c2-b9ab-29caa5c345e1 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:06.207865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8f700-d706-4e94-aa3b-598052f9eb69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:06.208486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8f700-d706-4e94-aa3b-598052f9eb69 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:06.208765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8f700-d706-4e94-aa3b-598052f9eb69 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:06.209038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8f700-d706-4e94-aa3b-598052f9eb69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:06.216528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8f700-d706-4e94-aa3b-598052f9eb69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:06.218092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8f700-d706-4e94-aa3b-598052f9eb69 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:06.226758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 687/1373] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:07.562501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245020a5-5734-4caa-ad7a-e21efb05ca23 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:07.563158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245020a5-5734-4caa-ad7a-e21efb05ca23 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:07.563158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245020a5-5734-4caa-ad7a-e21efb05ca23 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:07.564876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 687/1374] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:07.569739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2b3a-6297-4720-b242-868e9fe8c694 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:07.570163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2b3a-6297-4720-b242-868e9fe8c694 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:07.570296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2b3a-6297-4720-b242-868e9fe8c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:07.587214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8c6c2b3a-6297-4720-b242-868e9fe8c694 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:07.588377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8c6c2b3a-6297-4720-b242-868e9fe8c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:07.596138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 688/1375] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:07.747799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245020a5-5734-4caa-ad7a-e21efb05ca23 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:07.761373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245020a5-5734-4caa-ad7a-e21efb05ca23 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:07.766430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3be95-f948-4c63-bd14-498c16556265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:07.767158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3be95-f948-4c63-bd14-498c16556265 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:07.767715 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3be95-f948-4c63-bd14-498c16556265 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:07.768037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3be95-f948-4c63-bd14-498c16556265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:07.775581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3be95-f948-4c63-bd14-498c16556265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:07.777162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3be95-f948-4c63-bd14-498c16556265 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:07.786673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 688/1376] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:09.099861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddefa4e-efc3-48b0-bc13-d13bf45b923a None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:09.100437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddefa4e-efc3-48b0-bc13-d13bf45b923a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:09.100437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddefa4e-efc3-48b0-bc13-d13bf45b923a None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:09.102135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 689/1377] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:09.107061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcbd0e-0884-4947-9a4a-fc3f27564c67 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:09.107470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcbd0e-0884-4947-9a4a-fc3f27564c67 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:09.107612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcbd0e-0884-4947-9a4a-fc3f27564c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:09.124695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b3fcbd0e-0884-4947-9a4a-fc3f27564c67 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:09.125843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b3fcbd0e-0884-4947-9a4a-fc3f27564c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:09.134851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 689/1378] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:09.288275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddefa4e-efc3-48b0-bc13-d13bf45b923a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:09.301941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddefa4e-efc3-48b0-bc13-d13bf45b923a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:09.307019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63213452-351a-4aba-98b2-b532f30fed00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:09.307660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63213452-351a-4aba-98b2-b532f30fed00 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:09.307944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63213452-351a-4aba-98b2-b532f30fed00 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:09.308218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63213452-351a-4aba-98b2-b532f30fed00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:09.316506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63213452-351a-4aba-98b2-b532f30fed00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:09.318095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63213452-351a-4aba-98b2-b532f30fed00 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:09.326745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 690/1379] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:10.646904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9da90-73a6-431b-bfe7-091c3939f0d1 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:10.647471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9da90-73a6-431b-bfe7-091c3939f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:10.647471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9da90-73a6-431b-bfe7-091c3939f0d1 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:10.649249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 690/1380] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:10.654249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42172783-48fc-47e8-a927-5556649b8fe1 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:10.654646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42172783-48fc-47e8-a927-5556649b8fe1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:10.654818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42172783-48fc-47e8-a927-5556649b8fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:10.672227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-42172783-48fc-47e8-a927-5556649b8fe1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:10.674121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-42172783-48fc-47e8-a927-5556649b8fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:10.681192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 691/1381] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:10.832996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9da90-73a6-431b-bfe7-091c3939f0d1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:10.847215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9da90-73a6-431b-bfe7-091c3939f0d1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:10.852448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d98f-748b-4186-9a0a-e8124124815d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:10.853140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d98f-748b-4186-9a0a-e8124124815d service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:10.853380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d98f-748b-4186-9a0a-e8124124815d service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:10.853711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d98f-748b-4186-9a0a-e8124124815d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:10.861557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d98f-748b-4186-9a0a-e8124124815d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:10.863319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d98f-748b-4186-9a0a-e8124124815d service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:10.872182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 691/1382] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:12.208334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f8abb-ba3c-4241-bfa5-0b26ee072733 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:12.208894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f8abb-ba3c-4241-bfa5-0b26ee072733 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:12.208894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f8abb-ba3c-4241-bfa5-0b26ee072733 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:12.210648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 692/1383] 10.222.0.66 () {54 vars in 911 bytes} [Tue Jul 13 08:35:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:12.215521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a058b3-e81c-4895-860e-c16e9661265f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:12.215942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a058b3-e81c-4895-860e-c16e9661265f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:12.216087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a058b3-e81c-4895-860e-c16e9661265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:12.232935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-05a058b3-e81c-4895-860e-c16e9661265f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:12.234087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-05a058b3-e81c-4895-860e-c16e9661265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:12.242307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 692/1384] 10.222.0.66 () {58 vars in 1009 bytes} [Tue Jul 13 08:35:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:12.395560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f8abb-ba3c-4241-bfa5-0b26ee072733 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:12.408621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f8abb-ba3c-4241-bfa5-0b26ee072733 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:12.413574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562775-a363-4c9c-b5bb-a0bbae5114c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:12.414201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562775-a363-4c9c-b5bb-a0bbae5114c2 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:12.414482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562775-a363-4c9c-b5bb-a0bbae5114c2 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:12.414755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562775-a363-4c9c-b5bb-a0bbae5114c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:12.422217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562775-a363-4c9c-b5bb-a0bbae5114c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:12.424431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562775-a363-4c9c-b5bb-a0bbae5114c2 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:12.432905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 693/1385] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:14.499158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593201-31a6-4767-89d7-216b6dba7040 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:14.499687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593201-31a6-4767-89d7-216b6dba7040 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:14.499687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593201-31a6-4767-89d7-216b6dba7040 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:14.501455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 693/1386] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:14.506865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aa73e-4935-4f8c-80f5-c414d3a8421c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:14.507297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aa73e-4935-4f8c-80f5-c414d3a8421c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:14.507447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aa73e-4935-4f8c-80f5-c414d3a8421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:14.524913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d22aa73e-4935-4f8c-80f5-c414d3a8421c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:14.526127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d22aa73e-4935-4f8c-80f5-c414d3a8421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:14.533813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 694/1387] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:14.571912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593201-31a6-4767-89d7-216b6dba7040 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:14.582509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593201-31a6-4767-89d7-216b6dba7040 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:14.585961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec465033-e6b9-4b50-8255-6747e9119020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:14.586594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec465033-e6b9-4b50-8255-6747e9119020 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:14.586875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec465033-e6b9-4b50-8255-6747e9119020 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:14.587190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec465033-e6b9-4b50-8255-6747e9119020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:14.596276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec465033-e6b9-4b50-8255-6747e9119020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:14.597716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec465033-e6b9-4b50-8255-6747e9119020 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:14.606352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 694/1388] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:16.874035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155412c-fae8-4f38-96ae-0104dbc92e8c None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:16.874686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155412c-fae8-4f38-96ae-0104dbc92e8c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:16.874686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155412c-fae8-4f38-96ae-0104dbc92e8c None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:16.876992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 695/1389] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:16.885075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe93e-a696-44f7-a315-94c652e96f6f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:16.885572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe93e-a696-44f7-a315-94c652e96f6f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:16.885684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afe93e-a696-44f7-a315-94c652e96f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:16.902736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a8afe93e-a696-44f7-a315-94c652e96f6f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:16.903937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a8afe93e-a696-44f7-a315-94c652e96f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:16.911180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 695/1390] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:16.950701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155412c-fae8-4f38-96ae-0104dbc92e8c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:16.960730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155412c-fae8-4f38-96ae-0104dbc92e8c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:16.964016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79b80d-d17f-4d93-8ebc-23aff7fa6190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:16.964644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b80d-d17f-4d93-8ebc-23aff7fa6190 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:16.964926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b80d-d17f-4d93-8ebc-23aff7fa6190 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:16.965199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b80d-d17f-4d93-8ebc-23aff7fa6190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:16.973533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b80d-d17f-4d93-8ebc-23aff7fa6190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:16.974985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b80d-d17f-4d93-8ebc-23aff7fa6190 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:16.983513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 696/1391] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:19.437880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba935e-01c4-4989-900e-1a779f727e19 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:19.438481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba935e-01c4-4989-900e-1a779f727e19 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:19.439115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba935e-01c4-4989-900e-1a779f727e19 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:19.440851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 696/1392] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:19.446109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e810e-e63c-4328-8da1-148fca1fe27b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:19.446540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e810e-e63c-4328-8da1-148fca1fe27b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:19.446691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e810e-e63c-4328-8da1-148fca1fe27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:19.463735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1a7e810e-e63c-4328-8da1-148fca1fe27b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:19.464891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1a7e810e-e63c-4328-8da1-148fca1fe27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:19.472857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 697/1393] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:19.513361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba935e-01c4-4989-900e-1a779f727e19 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:19.524656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba935e-01c4-4989-900e-1a779f727e19 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:19.528018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276eb63-3f87-4d5c-9e1e-a9d242eacba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:19.528650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276eb63-3f87-4d5c-9e1e-a9d242eacba4 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:19.528932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276eb63-3f87-4d5c-9e1e-a9d242eacba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:19.529233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276eb63-3f87-4d5c-9e1e-a9d242eacba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:19.538683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276eb63-3f87-4d5c-9e1e-a9d242eacba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:19.540171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276eb63-3f87-4d5c-9e1e-a9d242eacba4 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:19.549616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 697/1394] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:21.872840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bbf90-758d-4619-98d4-5fe7acfe438e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:21.873446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bbf90-758d-4619-98d4-5fe7acfe438e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:21.873446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bbf90-758d-4619-98d4-5fe7acfe438e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:21.875191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 698/1395] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:21.880754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e5c5-7fd9-462f-9348-72150b7467ca None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:21.881288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e5c5-7fd9-462f-9348-72150b7467ca None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:21.881288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e5c5-7fd9-462f-9348-72150b7467ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:21.898545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-99c0e5c5-7fd9-462f-9348-72150b7467ca None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:21.899709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-99c0e5c5-7fd9-462f-9348-72150b7467ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:21.906795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 698/1396] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:21.946238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bbf90-758d-4619-98d4-5fe7acfe438e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:21.956433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bbf90-758d-4619-98d4-5fe7acfe438e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:21.959737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398496d4-3928-4fe5-a554-ac32ce216f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:21.960356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398496d4-3928-4fe5-a554-ac32ce216f38 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:21.960631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398496d4-3928-4fe5-a554-ac32ce216f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:21.960899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398496d4-3928-4fe5-a554-ac32ce216f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:21.968972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398496d4-3928-4fe5-a554-ac32ce216f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:21.971088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398496d4-3928-4fe5-a554-ac32ce216f38 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:21.979413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 699/1397] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:24.204451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab3ce-1173-4e9b-a87c-e3db25e7c86c None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:24.205036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab3ce-1173-4e9b-a87c-e3db25e7c86c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:24.205036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab3ce-1173-4e9b-a87c-e3db25e7c86c None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:24.206808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 699/1398] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:24.212321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9d0f-1ff7-4176-bd59-d17967b75f78 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:24.212825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9d0f-1ff7-4176-bd59-d17967b75f78 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:24.212982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a9d0f-1ff7-4176-bd59-d17967b75f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:24.230790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-527a9d0f-1ff7-4176-bd59-d17967b75f78 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:24.232004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-527a9d0f-1ff7-4176-bd59-d17967b75f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:24.240002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 700/1399] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:24.278899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ab3ce-1173-4e9b-a87c-e3db25e7c86c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:24.289802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ab3ce-1173-4e9b-a87c-e3db25e7c86c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:24.293241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289a08-0afb-4b4c-b5a6-4b221992e5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:24.293878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289a08-0afb-4b4c-b5a6-4b221992e5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:24.294163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289a08-0afb-4b4c-b5a6-4b221992e5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:24.294444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289a08-0afb-4b4c-b5a6-4b221992e5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:24.307727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289a08-0afb-4b4c-b5a6-4b221992e5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:24.309200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289a08-0afb-4b4c-b5a6-4b221992e5a3 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:24.318860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 700/1400] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:26.511001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918420-1634-41a6-86c8-d75e92617cf2 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:26.511540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918420-1634-41a6-86c8-d75e92617cf2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:26.511540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918420-1634-41a6-86c8-d75e92617cf2 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:26.513577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 701/1401] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:26.519573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662d8a-8ae8-4b6c-a8e0-574f8f6a1e67 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:26.520076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662d8a-8ae8-4b6c-a8e0-574f8f6a1e67 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:26.520183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662d8a-8ae8-4b6c-a8e0-574f8f6a1e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:26.537132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-31662d8a-8ae8-4b6c-a8e0-574f8f6a1e67 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:26.538294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-31662d8a-8ae8-4b6c-a8e0-574f8f6a1e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:26.545528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 701/1402] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:26.585613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918420-1634-41a6-86c8-d75e92617cf2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:26.597075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918420-1634-41a6-86c8-d75e92617cf2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:26.600474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62b6ec-41ea-4c1e-8e7b-32a91657426a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:26.601119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62b6ec-41ea-4c1e-8e7b-32a91657426a service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:26.601403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62b6ec-41ea-4c1e-8e7b-32a91657426a service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:26.601680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62b6ec-41ea-4c1e-8e7b-32a91657426a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:26.610789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62b6ec-41ea-4c1e-8e7b-32a91657426a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:26.612247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62b6ec-41ea-4c1e-8e7b-32a91657426a service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:26.622151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 702/1403] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:28.809519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc205-b03f-40bf-86d0-66a8846f6e59 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:28.810120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc205-b03f-40bf-86d0-66a8846f6e59 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:28.810120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc205-b03f-40bf-86d0-66a8846f6e59 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:28.811790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 702/1404] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:28.818081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1221-7d6b-4099-877c-e09f6891e537 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:28.818543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1221-7d6b-4099-877c-e09f6891e537 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:28.818650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1221-7d6b-4099-877c-e09f6891e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:28.835687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5bdc1221-7d6b-4099-877c-e09f6891e537 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:28.836844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5bdc1221-7d6b-4099-877c-e09f6891e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:28.843996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 703/1405] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:28.882634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacc205-b03f-40bf-86d0-66a8846f6e59 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:28.893765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacc205-b03f-40bf-86d0-66a8846f6e59 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:28.897215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1a6d6-984f-478f-a0dc-edac5a821875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:28.897849 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1a6d6-984f-478f-a0dc-edac5a821875 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:28.898132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1a6d6-984f-478f-a0dc-edac5a821875 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:28.898408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1a6d6-984f-478f-a0dc-edac5a821875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:28.906800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1a6d6-984f-478f-a0dc-edac5a821875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:28.908740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1a6d6-984f-478f-a0dc-edac5a821875 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:28.917369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 703/1406] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:31.072816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9a6d-fe31-4acb-8d3d-676258447d4c None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:31.073406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9a6d-fe31-4acb-8d3d-676258447d4c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:31.073406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9a6d-fe31-4acb-8d3d-676258447d4c None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:31.075448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 704/1407] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:31.081229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2908-4394-4ec0-956e-1eccb791b061 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:31.081661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2908-4394-4ec0-956e-1eccb791b061 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:31.081766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2908-4394-4ec0-956e-1eccb791b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:31.100085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-11ba2908-4394-4ec0-956e-1eccb791b061 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:31.101226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-11ba2908-4394-4ec0-956e-1eccb791b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:31.108543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 704/1408] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:31.145924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a9a6d-fe31-4acb-8d3d-676258447d4c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:31.156055 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a9a6d-fe31-4acb-8d3d-676258447d4c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:31.160167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5398-fcfe-4ab7-873b-8f9e9a1ba799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:31.160798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5398-fcfe-4ab7-873b-8f9e9a1ba799 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:31.161077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5398-fcfe-4ab7-873b-8f9e9a1ba799 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:31.161440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5398-fcfe-4ab7-873b-8f9e9a1ba799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:31.169764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5398-fcfe-4ab7-873b-8f9e9a1ba799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:31.171232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5398-fcfe-4ab7-873b-8f9e9a1ba799 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:31.179919 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 705/1409] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:33.335401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b24a9-1ad2-42c3-8fbc-47c6533c744a None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:33.335993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b24a9-1ad2-42c3-8fbc-47c6533c744a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:33.335993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b24a9-1ad2-42c3-8fbc-47c6533c744a None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:33.337701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 705/1410] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:33.342883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d96eda-573a-48e6-ab77-7d89edf7aa38 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:33.343302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d96eda-573a-48e6-ab77-7d89edf7aa38 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:33.343475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d96eda-573a-48e6-ab77-7d89edf7aa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:33.361630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-50d96eda-573a-48e6-ab77-7d89edf7aa38 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:33.362781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-50d96eda-573a-48e6-ab77-7d89edf7aa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:33.369919 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 706/1411] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:33.406430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b24a9-1ad2-42c3-8fbc-47c6533c744a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:33.417257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b24a9-1ad2-42c3-8fbc-47c6533c744a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:33.420626 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffa81f-32ae-4ca2-b6a1-8db30dcdf54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:33.421249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa81f-32ae-4ca2-b6a1-8db30dcdf54f service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:33.421537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa81f-32ae-4ca2-b6a1-8db30dcdf54f service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:33.421808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa81f-32ae-4ca2-b6a1-8db30dcdf54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:33.430117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffa81f-32ae-4ca2-b6a1-8db30dcdf54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:33.431564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffa81f-32ae-4ca2-b6a1-8db30dcdf54f service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:33.440123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 706/1412] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:35.592485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674e882-36d5-405f-894c-7c75a18d4951 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:35.593048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674e882-36d5-405f-894c-7c75a18d4951 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:35.593048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674e882-36d5-405f-894c-7c75a18d4951 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:35.595588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 707/1413] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:35.600961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cff2-64d9-4599-bd39-f3d22e853ef8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:35.601385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cff2-64d9-4599-bd39-f3d22e853ef8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:35.601517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cff2-64d9-4599-bd39-f3d22e853ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:35.619034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4111cff2-64d9-4599-bd39-f3d22e853ef8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:35.620197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4111cff2-64d9-4599-bd39-f3d22e853ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:35.627458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 707/1414] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:35.664372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674e882-36d5-405f-894c-7c75a18d4951 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:35.674401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674e882-36d5-405f-894c-7c75a18d4951 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:35.677723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df036add-f701-45f7-a9da-a0bd2969a812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:35.678346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df036add-f701-45f7-a9da-a0bd2969a812 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:35.678625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df036add-f701-45f7-a9da-a0bd2969a812 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:35.678893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df036add-f701-45f7-a9da-a0bd2969a812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:35.687307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df036add-f701-45f7-a9da-a0bd2969a812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:35.688857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df036add-f701-45f7-a9da-a0bd2969a812 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:35.697590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 708/1415] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:52.885397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616621b-f2e8-49c0-9289-4514196fb310 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:52.886007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616621b-f2e8-49c0-9289-4514196fb310 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:52.886356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616621b-f2e8-49c0-9289-4514196fb310 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:52.888797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 708/1416] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:52.895217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf92b8a-ddac-4cb1-976f-96860a0fa217 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:52.895754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf92b8a-ddac-4cb1-976f-96860a0fa217 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:52.895754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf92b8a-ddac-4cb1-976f-96860a0fa217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:52.913695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-caf92b8a-ddac-4cb1-976f-96860a0fa217 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:52.914852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-caf92b8a-ddac-4cb1-976f-96860a0fa217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:52.922027 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 709/1417] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:52.970148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919345-4104-41b1-a242-a4260bc8b45e None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:52.970431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919345-4104-41b1-a242-a4260bc8b45e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:52.970702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919345-4104-41b1-a242-a4260bc8b45e None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:52.972502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 709/1418] 10.222.0.66 () {54 vars in 962 bytes} [Tue Jul 13 08:35:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:52.977354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf029-cb35-4e0f-bea6-5241d6f49e53 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:52.977646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf029-cb35-4e0f-bea6-5241d6f49e53 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:52.977957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf029-cb35-4e0f-bea6-5241d6f49e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:52.997819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d2ebf029-cb35-4e0f-bea6-5241d6f49e53 None None] MFA Rules not processed for user `c2227b93e13c4a418b506b2a2c011c76`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:52.999041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d2ebf029-cb35-4e0f-bea6-5241d6f49e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:53.006013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 710/1419] 10.222.0.66 () {58 vars in 1060 bytes} [Tue Jul 13 08:35:52 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:53.014365 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919345-4104-41b1-a242-a4260bc8b45e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:53.024275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919345-4104-41b1-a242-a4260bc8b45e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:53.027486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9f788-5c03-4020-84b3-a0f1ddf68f73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:53.028107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f788-5c03-4020-84b3-a0f1ddf68f73 service glance] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:53.028383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f788-5c03-4020-84b3-a0f1ddf68f73 service glance] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:53.028651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f788-5c03-4020-84b3-a0f1ddf68f73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:53.037564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f788-5c03-4020-84b3-a0f1ddf68f73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:53.039029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f788-5c03-4020-84b3-a0f1ddf68f73 service glance] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:53.048386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 710/1420] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:55.283076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5e4e-48f7-4de7-a789-5a3044e5d1ac None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:55.283643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5e4e-48f7-4de7-a789-5a3044e5d1ac None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:55.283643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5e4e-48f7-4de7-a789-5a3044e5d1ac None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:55.285385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 711/1421] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:55.290688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8a6f-bc23-4e2a-80b5-fc75fc234c40 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:55.291130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8a6f-bc23-4e2a-80b5-fc75fc234c40 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:55.291287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8a6f-bc23-4e2a-80b5-fc75fc234c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:55.308712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-cd0f8a6f-bc23-4e2a-80b5-fc75fc234c40 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:55.309856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cd0f8a6f-bc23-4e2a-80b5-fc75fc234c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:55.317526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 711/1422] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:55.341714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5e4e-48f7-4de7-a789-5a3044e5d1ac None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:55.353915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5e4e-48f7-4de7-a789-5a3044e5d1ac None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:55.358039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e95715-dccd-49f5-bef6-a254ecafa883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:55.358677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e95715-dccd-49f5-bef6-a254ecafa883 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:55.358985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e95715-dccd-49f5-bef6-a254ecafa883 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:55.359261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e95715-dccd-49f5-bef6-a254ecafa883 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:55.360259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e95715-dccd-49f5-bef6-a254ecafa883 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:55.362117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e95715-dccd-49f5-bef6-a254ecafa883 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:55.380331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 712/1423] 10.222.0.66 () {56 vars in 1109 bytes} [Tue Jul 13 08:35:55 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:35:57.534191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586ad5e-5e4e-42ec-a85d-4054f5c49539 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:57.534728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586ad5e-5e4e-42ec-a85d-4054f5c49539 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:57.534728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586ad5e-5e4e-42ec-a85d-4054f5c49539 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:57.536628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 712/1424] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:57.541886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45a9c-a63c-492e-bdf7-16536406f9b1 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:57.542321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45a9c-a63c-492e-bdf7-16536406f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:57.542434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45a9c-a63c-492e-bdf7-16536406f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:57.560086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9de45a9c-a63c-492e-bdf7-16536406f9b1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:35:57.561247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9de45a9c-a63c-492e-bdf7-16536406f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:35:57.569067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 713/1425] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:35:57.611065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586ad5e-5e4e-42ec-a85d-4054f5c49539 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:35:57.623959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586ad5e-5e4e-42ec-a85d-4054f5c49539 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:35:57.628878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e879f58-e95f-48e7-ad97-227faa169414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:35:57.629503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879f58-e95f-48e7-ad97-227faa169414 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:57.629781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879f58-e95f-48e7-ad97-227faa169414 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:57.630055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e879f58-e95f-48e7-ad97-227faa169414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:57.637775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e879f58-e95f-48e7-ad97-227faa169414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:35:57.639374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e879f58-e95f-48e7-ad97-227faa169414 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:35:57.648452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 713/1426] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:35:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:35:59.989392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f60a4-7c3e-4ccc-a5d3-70fa2b4b0107 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:59.989974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f60a4-7c3e-4ccc-a5d3-70fa2b4b0107 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:59.989974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f60a4-7c3e-4ccc-a5d3-70fa2b4b0107 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:35:59.991751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 714/1427] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:35:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:35:59.997078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962339-1c81-4335-a4e4-69ab51fe34bc None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:35:59.997523 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962339-1c81-4335-a4e4-69ab51fe34bc None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:35:59.997645 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962339-1c81-4335-a4e4-69ab51fe34bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:00.015690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a2962339-1c81-4335-a4e4-69ab51fe34bc None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:36:00.017536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a2962339-1c81-4335-a4e4-69ab51fe34bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:36:00.024586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 714/1428] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:35:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:36:00.061118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f60a4-7c3e-4ccc-a5d3-70fa2b4b0107 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:36:00.072101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f60a4-7c3e-4ccc-a5d3-70fa2b4b0107 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:36:00.075449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11a19f-5251-44a4-84ec-f3514cd95927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:36:00.076087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11a19f-5251-44a4-84ec-f3514cd95927 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:00.076400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11a19f-5251-44a4-84ec-f3514cd95927 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:00.076700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11a19f-5251-44a4-84ec-f3514cd95927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:00.085827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11a19f-5251-44a4-84ec-f3514cd95927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:36:00.087329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11a19f-5251-44a4-84ec-f3514cd95927 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:36:00.096123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 715/1429] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:36:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:36:02.273444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2780d-8f57-4449-85d8-cbcfa264e8e6 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:02.274017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2780d-8f57-4449-85d8-cbcfa264e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:02.274017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2780d-8f57-4449-85d8-cbcfa264e8e6 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:02.275785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 715/1430] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:36:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:36:02.280986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1ff0-ccc6-4361-9ea9-a764a9cf85e7 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:02.282022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1ff0-ccc6-4361-9ea9-a764a9cf85e7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:02.282022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1ff0-ccc6-4361-9ea9-a764a9cf85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:02.300538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-294a1ff0-ccc6-4361-9ea9-a764a9cf85e7 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:36:02.301685 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-294a1ff0-ccc6-4361-9ea9-a764a9cf85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:36:02.308710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 716/1431] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:36:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:36:02.346808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2780d-8f57-4449-85d8-cbcfa264e8e6 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:36:02.356909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2780d-8f57-4449-85d8-cbcfa264e8e6 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:36:02.360443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa46855-9212-4d69-b8c9-bfa72df9c169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:36:02.361075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46855-9212-4d69-b8c9-bfa72df9c169 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:02.361387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46855-9212-4d69-b8c9-bfa72df9c169 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:02.361679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46855-9212-4d69-b8c9-bfa72df9c169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:02.370102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa46855-9212-4d69-b8c9-bfa72df9c169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:36:02.371596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa46855-9212-4d69-b8c9-bfa72df9c169 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:36:02.380592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 716/1432] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:36:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:36:04.597733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab82bc-a01c-47f6-8316-c03348b09731 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:04.598314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab82bc-a01c-47f6-8316-c03348b09731 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:04.598314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab82bc-a01c-47f6-8316-c03348b09731 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:04.600111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 717/1433] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:36:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:36:04.605388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427a50f-5cec-4e1f-bb05-8f0b9851a9e5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:04.605834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427a50f-5cec-4e1f-bb05-8f0b9851a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:04.606024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427a50f-5cec-4e1f-bb05-8f0b9851a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:04.623231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3427a50f-5cec-4e1f-bb05-8f0b9851a9e5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:36:04.624416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3427a50f-5cec-4e1f-bb05-8f0b9851a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:36:04.631556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 717/1434] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:36:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:36:04.672825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab82bc-a01c-47f6-8316-c03348b09731 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:36:04.683116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab82bc-a01c-47f6-8316-c03348b09731 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:36:04.686459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae796b-22b5-431f-b9c4-a44c5240d28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:36:04.687127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae796b-22b5-431f-b9c4-a44c5240d28d service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:04.687413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae796b-22b5-431f-b9c4-a44c5240d28d service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:04.687742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae796b-22b5-431f-b9c4-a44c5240d28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:04.696226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae796b-22b5-431f-b9c4-a44c5240d28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:36:04.697644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae796b-22b5-431f-b9c4-a44c5240d28d service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:36:04.706261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 718/1435] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:36:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:36:07.196232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d853a54-2edc-4edc-9038-1714d0a77590 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:07.196847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d853a54-2edc-4edc-9038-1714d0a77590 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:07.196847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d853a54-2edc-4edc-9038-1714d0a77590 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:07.198578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 718/1436] 10.222.0.66 () {54 vars in 926 bytes} [Tue Jul 13 08:36:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:36:07.205168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b8b9-7bed-428e-bd11-71802444e92f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:07.205697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b8b9-7bed-428e-bd11-71802444e92f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:07.205697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b8b9-7bed-428e-bd11-71802444e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:07.224143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5ae6b8b9-7bed-428e-bd11-71802444e92f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:36:07.225322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5ae6b8b9-7bed-428e-bd11-71802444e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:36:07.232883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 719/1437] 10.222.0.66 () {58 vars in 1024 bytes} [Tue Jul 13 08:36:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:36:07.280622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d853a54-2edc-4edc-9038-1714d0a77590 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:36:07.292822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d853a54-2edc-4edc-9038-1714d0a77590 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:36:07.296330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce278f3-614c-4fb5-9f73-615c137968b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:36:07.297527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce278f3-614c-4fb5-9f73-615c137968b0 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:36:07.297811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce278f3-614c-4fb5-9f73-615c137968b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:36:07.298294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce278f3-614c-4fb5-9f73-615c137968b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:36:07.307686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce278f3-614c-4fb5-9f73-615c137968b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:36:07.309150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce278f3-614c-4fb5-9f73-615c137968b0 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:36:07.319611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 719/1438] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:36:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:37:25.767195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:25.767835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:25.767835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:25.785104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:37:25.786264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:37:25.793557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 720/1439] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:37:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:37:25.802552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:25.803139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:25.803244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:25.821983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:37:25.823388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:37:25.830788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 720/1440] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:37:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:37:25.835623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:25.845549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a8e2-56b2-4f04-8871-5b2a344c7ea7 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:25.849926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:25.850586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:25.850874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:25.851182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:25.851913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:37:25.852219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:25.853849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:25.866249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 721/1441] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:37:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:37:25.876405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:25.885378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10114a89-4356-4b90-afd0-b5da9f3fc10f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:25.889781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:25.891040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:25.891328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:25.891601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:25.892302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:25.894218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:25.931730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 721/1442] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:37:25 2021] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:37:25.935996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:25.945518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122719d-1b22-400b-a0bf-409dbaa92efe admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.000373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.001044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.001332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.001627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.002331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.004295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.027613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 722/1443] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:37:25 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:37:26.032647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:26.042220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f8ec4-cea5-41f7-bfed-62acfde5dc27 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.046825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.047527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.047814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.048094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.048819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.050426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.065001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 722/1444] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:37:26 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:37:26.069130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:26.079028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9aad0-e02c-4267-93c5-1f1b7e3185b3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.083194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ea15-cfd5-4d81-9d4f-685185752a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.083843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ea15-cfd5-4d81-9d4f-685185752a32 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.084126 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ea15-cfd5-4d81-9d4f-685185752a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.084401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ea15-cfd5-4d81-9d4f-685185752a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.085246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961ea15-cfd5-4d81-9d4f-685185752a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.087019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961ea15-cfd5-4d81-9d4f-685185752a32 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.101138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 723/1445] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:37:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:37:26.105294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:26.114404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886b39-8e09-4117-9a1f-ae0f4bf71ec9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.118706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.119607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.119885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.120153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] PATH_INFO: `/v3/projects/214299fb25184676aca069b8437acae7/users/1f8621f51d12439dbc064660e3dc0322/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.134474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214299fb25184676aca069b8437acae7, user_id=1f8621f51d12439dbc064660e3dc0322, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.137127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.150726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 723/1446] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:37:26 2021] PUT /identity/v3/projects/214299fb25184676aca069b8437acae7/users/1f8621f51d12439dbc064660e3dc0322/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:37:26.162864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dd812-6b48-49e2-b48f-5f6a85997caf None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.163180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dd812-6b48-49e2-b48f-5f6a85997caf None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.163455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dd812-6b48-49e2-b48f-5f6a85997caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.191598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-486dd812-6b48-49e2-b48f-5f6a85997caf None None] MFA Rules not processed for user `1f8621f51d12439dbc064660e3dc0322`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:37:26.192822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-486dd812-6b48-49e2-b48f-5f6a85997caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:37:26.258231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 724/1447] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:37:26 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:37:26.269882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:26.340559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cec6e-42c1-4f36-bed8-dbef4bb24da8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.345725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.346372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.346656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.346952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.354861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.356496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.365232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 724/1448] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:37:26 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:37:26.437741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b148f-888b-49b7-81d9-e7ea3ef30044 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.438034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b148f-888b-49b7-81d9-e7ea3ef30044 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.438302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b148f-888b-49b7-81d9-e7ea3ef30044 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.440055 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 725/1449] 10.222.0.66 () {52 vars in 829 bytes} [Tue Jul 13 08:37:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:37:26.444178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:26.505927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639f65a-9244-4d11-a073-805e68590108 service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.510548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.511456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.511737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.512010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] PATH_INFO: `/v3/users/1f8621f51d12439dbc064660e3dc0322` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.513217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8621f51d12439dbc064660e3dc0322)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.514228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:37:26.514228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:37:26.514228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:37:26.516126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.594140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8621f51d12439dbc064660e3dc0322'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:26.605835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8621f51d12439dbc064660e3dc0322'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:26.606512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8621f51d12439dbc064660e3dc0322'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:26.627994 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8621f51d12439dbc064660e3dc0322'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:26.637853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8621f51d12439dbc064660e3dc0322'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:26.647297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 725/1450] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:37:26 2021] DELETE /identity/v3/users/1f8621f51d12439dbc064660e3dc0322 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:37:26.651835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.652120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.652399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.670713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:37:26.673053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:37:26.732095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 726/1451] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:37:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:37:26.743249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:26.744618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:37:26.799113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eca6d-cd5e-474a-8588-3d7858939482 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:26.802460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273383-e919-4e94-9596-46aa726b210b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:26.803126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273383-e919-4e94-9596-46aa726b210b service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:26.803767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273383-e919-4e94-9596-46aa726b210b service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:26.803767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273383-e919-4e94-9596-46aa726b210b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:26.812793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273383-e919-4e94-9596-46aa726b210b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:26.814230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273383-e919-4e94-9596-46aa726b210b service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:26.822890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 726/1452] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:37:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:37:27.228877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:37:27.230762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:37:27.242075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bafbe5-b8fd-4069-a790-e4569c0f9e5b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:37:27.246766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:37:27.247571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:37:27.247848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:37:27.248129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] PATH_INFO: `/v3/projects/214299fb25184676aca069b8437acae7` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:37:27.249334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=214299fb25184676aca069b8437acae7)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:37:27.250372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:37:27.250372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:37:27.250372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:37:27.251619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:37:27.316572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214299fb25184676aca069b8437acae7', 'request_id': 'req-dc23902d-98ed-48bb-9451-861fca330c8c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:27.322786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214299fb25184676aca069b8437acae7', 'request_id': 'req-dc23902d-98ed-48bb-9451-861fca330c8c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:27.333279 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214299fb25184676aca069b8437acae7', 'request_id': 'req-dc23902d-98ed-48bb-9451-861fca330c8c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:27.356748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] The token cache is being invalidate because project 214299fb25184676aca069b8437acae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:37:27.357036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:27.357812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc23902d-98ed-48bb-9451-861fca330c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:37:27.359418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 727/1453] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:37:27 2021] DELETE /identity/v3/projects/214299fb25184676aca069b8437acae7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:38:55.804044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f618-54a7-4542-a231-4d52edefcd10 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:55.805647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f618-54a7-4542-a231-4d52edefcd10 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:55.805928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f618-54a7-4542-a231-4d52edefcd10 None None] PATH_INFO: `/v3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:55.807400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 727/1454] 10.222.0.70 () {54 vars in 926 bytes} [Tue Jul 13 08:38:55 2021] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:38:55.813563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938ee0f-c179-4873-836b-f3a729128ec4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:55.814045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938ee0f-c179-4873-836b-f3a729128ec4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:55.814148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938ee0f-c179-4873-836b-f3a729128ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:55.831216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f938ee0f-c179-4873-836b-f3a729128ec4 None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:38:55.832386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f938ee0f-c179-4873-836b-f3a729128ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:38:55.893411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 728/1455] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Jul 13 08:38:55 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:38:58.917817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9539c-82e4-41be-82c0-f6aea463623b None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:58.918383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9539c-82e4-41be-82c0-f6aea463623b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:58.918383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9539c-82e4-41be-82c0-f6aea463623b None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:58.920160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 728/1456] 10.222.0.66 () {54 vars in 960 bytes} [Tue Jul 13 08:38:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:38:58.928708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ba329-e569-4970-9520-3d357b14909a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:58.929198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ba329-e569-4970-9520-3d357b14909a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:58.929384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ba329-e569-4970-9520-3d357b14909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:58.948329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a70ba329-e569-4970-9520-3d357b14909a None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:38:58.949486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a70ba329-e569-4970-9520-3d357b14909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:38:58.957156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 729/1457] 10.222.0.66 () {58 vars in 1058 bytes} [Tue Jul 13 08:38:58 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:38:58.965395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9539c-82e4-41be-82c0-f6aea463623b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:38:58.978623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9539c-82e4-41be-82c0-f6aea463623b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:38:58.983244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ed80-1dc1-4648-9765-8104b422466f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:38:58.983881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ed80-1dc1-4648-9765-8104b422466f service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:58.984172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ed80-1dc1-4648-9765-8104b422466f service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:58.984450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ed80-1dc1-4648-9765-8104b422466f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:58.992768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ed80-1dc1-4648-9765-8104b422466f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:38:58.994847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ed80-1dc1-4648-9765-8104b422466f service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:38:59.004474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 729/1458] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:38:58 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:38:59.969264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8356b7b-204c-4985-8bc9-233e4c9d8efb None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:59.969845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8356b7b-204c-4985-8bc9-233e4c9d8efb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:59.969845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8356b7b-204c-4985-8bc9-233e4c9d8efb None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:59.971616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 13 08:38:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:38:59.976985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b221-4ea3-4119-8d19-e4f07fcc52f7 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:38:59.977732 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b221-4ea3-4119-8d19-e4f07fcc52f7 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:38:59.977934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b221-4ea3-4119-8d19-e4f07fcc52f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:38:59.996247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9ee8b221-4ea3-4119-8d19-e4f07fcc52f7 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:38:59.997427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9ee8b221-4ea3-4119-8d19-e4f07fcc52f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:00.054699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 999 bytes} [Tue Jul 13 08:38:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:00.205891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8356b7b-204c-4985-8bc9-233e4c9d8efb None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:39:00.207523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a8356b7b-204c-4985-8bc9-233e4c9d8efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:00.277879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8356b7b-204c-4985-8bc9-233e4c9d8efb None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:39:00.282843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c4ee-a2f0-40fd-8c76-61bb62b31f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:39:00.283510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c4ee-a2f0-40fd-8c76-61bb62b31f6f service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:00.283789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c4ee-a2f0-40fd-8c76-61bb62b31f6f service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:00.284062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c4ee-a2f0-40fd-8c76-61bb62b31f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:00.292007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0c4ee-a2f0-40fd-8c76-61bb62b31f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:39:00.293635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0c4ee-a2f0-40fd-8c76-61bb62b31f6f service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:39:00.302020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 731/1461] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:39:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:39:01.662292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e689738-c6e6-4981-9f83-d911c034fc87 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:01.662890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e689738-c6e6-4981-9f83-d911c034fc87 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:01.662890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e689738-c6e6-4981-9f83-d911c034fc87 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:01.665152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 13 08:39:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:39:01.670179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523740-60dc-4aca-a7ce-58ee19a3c032 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:01.670627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523740-60dc-4aca-a7ce-58ee19a3c032 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:01.670737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523740-60dc-4aca-a7ce-58ee19a3c032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:01.688506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-98523740-60dc-4aca-a7ce-58ee19a3c032 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:39:01.689645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-98523740-60dc-4aca-a7ce-58ee19a3c032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:01.696750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 999 bytes} [Tue Jul 13 08:39:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:01.849206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e689738-c6e6-4981-9f83-d911c034fc87 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:39:01.863896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e689738-c6e6-4981-9f83-d911c034fc87 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:39:01.869914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109724-9a37-4b83-8643-96ae8b914abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:39:01.870589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109724-9a37-4b83-8643-96ae8b914abe service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:01.870871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109724-9a37-4b83-8643-96ae8b914abe service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:01.871212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109724-9a37-4b83-8643-96ae8b914abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:01.880594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94109724-9a37-4b83-8643-96ae8b914abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:39:01.883209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94109724-9a37-4b83-8643-96ae8b914abe service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:39:01.895591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 732/1464] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:39:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:39:05.870762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23db0f3-b49a-4c5d-b425-b93fe7b8ecb2 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:05.871359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23db0f3-b49a-4c5d-b425-b93fe7b8ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:05.871359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23db0f3-b49a-4c5d-b425-b93fe7b8ecb2 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:05.873095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 13 08:39:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:39:05.879607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab891e-0851-477e-8ce8-94f92fe7b4d8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:05.880182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab891e-0851-477e-8ce8-94f92fe7b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:05.880981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab891e-0851-477e-8ce8-94f92fe7b4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:05.903952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-89ab891e-0851-477e-8ce8-94f92fe7b4d8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:39:05.905150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-89ab891e-0851-477e-8ce8-94f92fe7b4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:05.912520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Jul 13 08:39:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:05.950928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23db0f3-b49a-4c5d-b425-b93fe7b8ecb2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:39:05.952570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f23db0f3-b49a-4c5d-b425-b93fe7b8ecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:06.007748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23db0f3-b49a-4c5d-b425-b93fe7b8ecb2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:39:06.011793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80585c9-e05d-4f13-a6dd-f7de60979f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:39:06.012445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80585c9-e05d-4f13-a6dd-f7de60979f93 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:06.012722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80585c9-e05d-4f13-a6dd-f7de60979f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:06.012994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80585c9-e05d-4f13-a6dd-f7de60979f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:06.021536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80585c9-e05d-4f13-a6dd-f7de60979f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:39:06.022992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80585c9-e05d-4f13-a6dd-f7de60979f93 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:39:06.032153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 734/1467] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:39:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:39:08.173813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba774-41f6-4959-a793-992a3d7e1b78 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:08.174387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba774-41f6-4959-a793-992a3d7e1b78 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:08.174387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba774-41f6-4959-a793-992a3d7e1b78 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:08.176170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 13 08:39:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:39:08.181335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a98d-8886-43d3-b8c5-d56ab2616460 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:08.181798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a98d-8886-43d3-b8c5-d56ab2616460 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:08.181890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a98d-8886-43d3-b8c5-d56ab2616460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:08.199236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d544a98d-8886-43d3-b8c5-d56ab2616460 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:39:08.200412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d544a98d-8886-43d3-b8c5-d56ab2616460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:08.207637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Jul 13 08:39:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:08.245578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba774-41f6-4959-a793-992a3d7e1b78 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:39:08.247253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a7aba774-41f6-4959-a793-992a3d7e1b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:08.261386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba774-41f6-4959-a793-992a3d7e1b78 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:39:08.265091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fb752-5190-4db2-a165-97d18b685eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:39:08.265890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fb752-5190-4db2-a165-97d18b685eca service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:08.266164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fb752-5190-4db2-a165-97d18b685eca service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:08.266444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fb752-5190-4db2-a165-97d18b685eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:08.276054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fb752-5190-4db2-a165-97d18b685eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:39:08.277599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fb752-5190-4db2-a165-97d18b685eca service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:39:08.286506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 735/1470] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:39:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:39:11.895698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a60bb-705b-4b8f-9fa2-663ff226f7c7 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:11.896265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a60bb-705b-4b8f-9fa2-663ff226f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:11.896516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a60bb-705b-4b8f-9fa2-663ff226f7c7 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:11.898456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 736/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 13 08:39:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:39:11.905041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1966b-786c-4afc-86a0-89eb9266c0c7 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:11.905523 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1966b-786c-4afc-86a0-89eb9266c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:11.905606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1966b-786c-4afc-86a0-89eb9266c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:11.924721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6ba1966b-786c-4afc-86a0-89eb9266c0c7 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:39:11.925890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6ba1966b-786c-4afc-86a0-89eb9266c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:11.937467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 736/1472] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Jul 13 08:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:11.995345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a60bb-705b-4b8f-9fa2-663ff226f7c7 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:39:11.997071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-477a60bb-705b-4b8f-9fa2-663ff226f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:12.058173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a60bb-705b-4b8f-9fa2-663ff226f7c7 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:39:12.061769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5c405-681c-429e-9f4a-7dc02a37ddc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:39:12.062437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5c405-681c-429e-9f4a-7dc02a37ddc6 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:12.062728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5c405-681c-429e-9f4a-7dc02a37ddc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:12.063060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5c405-681c-429e-9f4a-7dc02a37ddc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:12.073148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5c405-681c-429e-9f4a-7dc02a37ddc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:39:12.074627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5c405-681c-429e-9f4a-7dc02a37ddc6 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:39:12.084159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 737/1473] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:39:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:39:14.230615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88664-35a5-4b7e-98f3-8c1259c3a466 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:14.231217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88664-35a5-4b7e-98f3-8c1259c3a466 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:14.231217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88664-35a5-4b7e-98f3-8c1259c3a466 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:14.232961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 737/1474] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 13 08:39:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:39:14.238148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826909ab-98c4-4d09-a998-9ff4ec595b0c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:14.238645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826909ab-98c4-4d09-a998-9ff4ec595b0c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:14.238751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826909ab-98c4-4d09-a998-9ff4ec595b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:14.257066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-826909ab-98c4-4d09-a998-9ff4ec595b0c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:39:14.258238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-826909ab-98c4-4d09-a998-9ff4ec595b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:14.266083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 738/1475] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Jul 13 08:39:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:14.324277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327df8e-de05-4cfd-a245-a13bc8b4b228 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:14.324598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327df8e-de05-4cfd-a245-a13bc8b4b228 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:14.324880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327df8e-de05-4cfd-a245-a13bc8b4b228 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:14.326667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 738/1476] 10.222.0.66 () {54 vars in 963 bytes} [Tue Jul 13 08:39:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:39:14.331939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e6a6-17cd-4a73-ac50-6c3b4560615e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:14.332228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e6a6-17cd-4a73-ac50-6c3b4560615e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:14.332500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2e6a6-17cd-4a73-ac50-6c3b4560615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:14.349790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0ed2e6a6-17cd-4a73-ac50-6c3b4560615e None None] MFA Rules not processed for user `679ea61fafe040cdb5235aae7ff59f81`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:39:14.351073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0ed2e6a6-17cd-4a73-ac50-6c3b4560615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:39:14.357797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 739/1477] 10.222.0.66 () {58 vars in 1061 bytes} [Tue Jul 13 08:39:14 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:39:14.365901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327df8e-de05-4cfd-a245-a13bc8b4b228 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:39:14.376542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327df8e-de05-4cfd-a245-a13bc8b4b228 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:39:14.379965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9ea2e-0b2c-44b2-9a4b-ff31be5d67f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:39:14.380856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9ea2e-0b2c-44b2-9a4b-ff31be5d67f3 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:39:14.381138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9ea2e-0b2c-44b2-9a4b-ff31be5d67f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:39:14.381417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9ea2e-0b2c-44b2-9a4b-ff31be5d67f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:39:14.390424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9ea2e-0b2c-44b2-9a4b-ff31be5d67f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:39:14.391907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9ea2e-0b2c-44b2-9a4b-ff31be5d67f3 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:39:14.402585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 739/1478] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:39:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:33.041506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.042109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.042109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.067923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.069149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.077447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 740/1479] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.086716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.087282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.087282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.117717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.119864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.129515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 740/1480] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.135328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.149507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b8388-a6d7-4fea-bd54-97d541cd352f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.157180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.157860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.158144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.158421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.159181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.159488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.161261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9081ae-aeb0-4f18-af53-cd24456a7c64 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.184373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 741/1481] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.193071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.207063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfcad-3263-4ebf-940f-df2d8cb6bdc1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.212400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.213299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.213737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384d546-e8a2-439c-a366-6ff3e414b002 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.213966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.214122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384d546-e8a2-439c-a366-6ff3e414b002 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.214489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.214966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384d546-e8a2-439c-a366-6ff3e414b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.215398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.217431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.242572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d384d546-e8a2-439c-a366-6ff3e414b002 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.244141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d384d546-e8a2-439c-a366-6ff3e414b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.255264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 742/1482] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.266177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4c26-ee71-463b-83f9-71ed75973fc0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.267433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4c26-ee71-463b-83f9-71ed75973fc0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.269389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4c26-ee71-463b-83f9-71ed75973fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.285203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 741/1483] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:33.296241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.333362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-900a4c26-ee71-463b-83f9-71ed75973fc0 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.335135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-900a4c26-ee71-463b-83f9-71ed75973fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.389259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce512-3ca9-43e7-9db2-157212f0e0ac admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.399623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff4b7d-d786-457c-8492-88d24a8e174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.405647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4b7d-d786-457c-8492-88d24a8e174b admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.405647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4b7d-d786-457c-8492-88d24a8e174b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.405647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4b7d-d786-457c-8492-88d24a8e174b admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.405647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff4b7d-d786-457c-8492-88d24a8e174b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.405647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff4b7d-d786-457c-8492-88d24a8e174b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.417748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 743/1484] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:33.421983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d7f2b-4a65-43b8-9437-803edce1d0a9 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.422785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d7f2b-4a65-43b8-9437-803edce1d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.423112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d7f2b-4a65-43b8-9437-803edce1d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.442427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 742/1485] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:33.443255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.444165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.444594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.454650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6c7d7f2b-4a65-43b8-9437-803edce1d0a9 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.455851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6c7d7f2b-4a65-43b8-9437-803edce1d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.463584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 744/1486] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.464250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.465009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b8d7-b3be-44d0-97ee-5d4f49409c23 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.465302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b8d7-b3be-44d0-97ee-5d4f49409c23 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.465576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b8d7-b3be-44d0-97ee-5d4f49409c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.465706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.473127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 743/1487] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.478530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.483629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f684b8d7-b3be-44d0-97ee-5d4f49409c23 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.484795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f684b8d7-b3be-44d0-97ee-5d4f49409c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.487719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496aea0-ec49-4a76-8d26-723f76c72657 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.492999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.493156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 745/1488] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.494060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331cf7-bd16-4e7e-89c1-2dcd534f185a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.494429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331cf7-bd16-4e7e-89c1-2dcd534f185a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.494714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331cf7-bd16-4e7e-89c1-2dcd534f185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.495663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.496169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.496464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.497323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.497646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.499339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.519272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 744/1489] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.519492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-dd331cf7-bd16-4e7e-89c1-2dcd534f185a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.519596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.519708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-dd331cf7-bd16-4e7e-89c1-2dcd534f185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.521488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 746/1490] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.523177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72acc02-39fe-4375-98d9-ec4af49357c2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.523469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72acc02-39fe-4375-98d9-ec4af49357c2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.523752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72acc02-39fe-4375-98d9-ec4af49357c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.526197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e952a8-c981-4eba-985d-d5bd6434b81e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.530612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52b1b2-6ba0-4387-9b45-d4914ca8858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.531466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52b1b2-6ba0-4387-9b45-d4914ca8858f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.531749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52b1b2-6ba0-4387-9b45-d4914ca8858f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.532025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52b1b2-6ba0-4387-9b45-d4914ca8858f admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.532747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52b1b2-6ba0-4387-9b45-d4914ca8858f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.534355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52b1b2-6ba0-4387-9b45-d4914ca8858f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.541140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e72acc02-39fe-4375-98d9-ec4af49357c2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.542310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e72acc02-39fe-4375-98d9-ec4af49357c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.545505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 745/1491] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:33.546815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98bb36-9511-43a1-bbd6-621e90d29e07 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.547071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98bb36-9511-43a1-bbd6-621e90d29e07 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.547347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98bb36-9511-43a1-bbd6-621e90d29e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.549859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 747/1492] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.551120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94ed1-2429-471b-a3ff-aa643b3db844 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.551400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94ed1-2429-471b-a3ff-aa643b3db844 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.551673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94ed1-2429-471b-a3ff-aa643b3db844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.565375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6e98bb36-9511-43a1-bbd6-621e90d29e07 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.566540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6e98bb36-9511-43a1-bbd6-621e90d29e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.570932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-10d94ed1-2429-471b-a3ff-aa643b3db844 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.572000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-10d94ed1-2429-471b-a3ff-aa643b3db844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.574684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 746/1493] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.576038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.576328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.576657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.584768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 748/1494] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.586186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35614c40-88a5-4202-85bd-8c9455c90fa2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.586486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35614c40-88a5-4202-85bd-8c9455c90fa2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.586763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35614c40-88a5-4202-85bd-8c9455c90fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.595124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.596294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.604230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 747/1495] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.604594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-35614c40-88a5-4202-85bd-8c9455c90fa2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.605018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.605733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-35614c40-88a5-4202-85bd-8c9455c90fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.613042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 749/1496] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.614291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.614569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95f0d-89fe-46e9-b27a-04af90be2480 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.614690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.614850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.619647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2f8fb-49b3-494a-b376-bec1a33ced29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.620329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2f8fb-49b3-494a-b376-bec1a33ced29 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.620616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2f8fb-49b3-494a-b376-bec1a33ced29 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.620889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2f8fb-49b3-494a-b376-bec1a33ced29 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.621599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2f8fb-49b3-494a-b376-bec1a33ced29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.623561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2f8fb-49b3-494a-b376-bec1a33ced29 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.634424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.635636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.643190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 750/1497] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.643928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.654291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 748/1498] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:33.654291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.654291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.654291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.657039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf87a1-1534-49d6-af47-13676910ed79 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.670638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.671858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.711425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17592a8-e594-4105-91e2-595b9d751c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.712260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17592a8-e594-4105-91e2-595b9d751c56 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.712546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17592a8-e594-4105-91e2-595b9d751c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.712827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17592a8-e594-4105-91e2-595b9d751c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.713547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17592a8-e594-4105-91e2-595b9d751c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.715234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17592a8-e594-4105-91e2-595b9d751c56 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.725162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 751/1499] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:33.726435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.726729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.727040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.730015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 749/1500] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.730796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.740058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e451e8e-791f-4960-8685-486b2c4bcebe None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.744618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:33.745564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.745787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:33.746219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.746561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.746777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.747531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.747867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.749469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.753449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 752/1501] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:33.754492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.768309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 750/1502] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.768309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.768552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb04669-3eab-4419-a990-63fb71b3146a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.772167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.772982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.773106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.773390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.774117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.774428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.776155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.777470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da6eda-823e-4467-a5b5-329a64694fd4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.781783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.782433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.782720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.783033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.783748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.784057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.785645 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.788129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 753/1503] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.788933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.797723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b750b8-ac6b-431d-abb8-78b23a7e8984 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.801970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.802640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.803588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.803867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.804580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.804887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.806021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 751/1504] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.806846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.807077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.815498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1025d1-50ee-450e-a753-4f9b2832e44f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.819621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 754/1505] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.819920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.820295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.820567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.820848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.821119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.821797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.823748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.829180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d656f71-2f14-4048-9ec8-a67ad48fe40d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.834327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.835625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.836093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.836543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] PATH_INFO: `/v3/projects/ffc9e3e18ab1455e98c26d93e2361b9a/users/4fa0a11854d644bab448efc0fbaeecb7/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.845011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 752/1506] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/users => generated 290 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:33.846078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.856186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc9e3e18ab1455e98c26d93e2361b9a, user_id=4fa0a11854d644bab448efc0fbaeecb7, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.856485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3458a-6c0b-4701-8f34-04da03c66fd0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.858885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.860974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.861515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.861804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.862083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.862807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.863297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.865859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.873407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 755/1507] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:33 2021] PUT /identity/v3/projects/ffc9e3e18ab1455e98c26d93e2361b9a/users/4fa0a11854d644bab448efc0fbaeecb7/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:33.874129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.884108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 753/1508] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.884971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.894692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1caa61-3fae-4c71-acbe-ce2afb60defc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.941571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40e0a3-23a4-4a1c-984e-b3a6f1df10fb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.946453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.947142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.947428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.947705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.948427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:33.948549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.948854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.949272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.949553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.949846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.950472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.950593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.952427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.962554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 756/1509] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:33.963367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:33.972115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2b25-1316-4b4c-adaf-aaf6da497d1a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:33.977910 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:33.978559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:33.979012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:33.979473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:33.980139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:33.982048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:33.988770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 754/1510] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:33.988770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.011975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 757/1511] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.011975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.045324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709589c-5bdf-4919-9c07-08aef8559100 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.068268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b536212-ab30-4353-8945-756bf4bdf6f7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.072770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.073438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.073722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.073998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.074684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.076649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.099130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd975743-6d0c-4621-9721-c1c23b9d6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.100429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975743-6d0c-4621-9721-c1c23b9d6920 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.100733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975743-6d0c-4621-9721-c1c23b9d6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.101173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd975743-6d0c-4621-9721-c1c23b9d6920 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.101949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd975743-6d0c-4621-9721-c1c23b9d6920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.106148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 758/1512] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.106148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.106396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd975743-6d0c-4621-9721-c1c23b9d6920 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.130085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 755/1513] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:33 2021] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.131676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.131973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.132369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.157861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] MFA Rules not processed for user `4fa0a11854d644bab448efc0fbaeecb7`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:34.159092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:34.163769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a36b-f24c-4824-90f0-e49dbca41df8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.217717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.218418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.218831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.219169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.219899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.221487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 756/1514] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:34.221619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.223827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.234750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 759/1515] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.234750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.235073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227987-18d2-4a34-a034-60fb618f5c8e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.238466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.239169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.239503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.239788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.241340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.243065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.246409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc691dc1-a98f-4b6f-a846-7350f0a367a3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.250734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.251415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.251700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.251978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.252660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.254826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.271629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 757/1516] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.271629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.283962 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 760/1517] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.284622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.328071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6be29-14a1-45e5-bcfa-85a48530792a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.345283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab216a7c-6250-47c1-9754-b1601cada959 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.350844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.351550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.351834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.352117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.352834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.355108 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.374813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 761/1518] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.376000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.383256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.383932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.384256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.384535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.384846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187221-288e-495d-a0c9-77cf0f103b6b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.385217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.387196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.389253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.389905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.390190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.390465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.391167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.393196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.408292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 758/1519] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.409481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.414857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 762/1520] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 287 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.415875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.419135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d90ff-b758-4b08-a17f-e20f63f869b7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.423618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.424280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.424564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.424836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.424976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568a9f-be63-4895-9c55-49f8eedb4d81 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.425520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.427477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.430368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.431062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.431348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.431630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.432319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.434444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.448258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 759/1521] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.449366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.459377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6c7ad-b8ed-4819-a7d2-7ec9fc6ca55a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.463249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 763/1522] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.463957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.464061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.464717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.464998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.465282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.466011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.467718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.482092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 760/1523] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.482092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.491272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9855c-525f-4aaa-978b-52b5ca118b9b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.526154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d41c7-b6f7-49e8-a348-5c2ddf3387d0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.530594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.531306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.531591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.531864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.532549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.534494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.548438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.549160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.549443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.549718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.550430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.552385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.557618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 764/1524] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.557618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.564674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d55e8-12dd-4fda-aa2d-2e76aca4f6a9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.571183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.571849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.572127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.572402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.573112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.573433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 761/1525] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.574262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.574729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.585688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e919f-932c-4b47-961f-4dca16082793 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.585865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 765/1526] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.586470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.591604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.592291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.592569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.592856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.593564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.595167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.597644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca3f4-0c4c-409e-8f19-51d506d11620 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.602217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.603013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.603299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.603601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.604313 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.608924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 762/1527] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.609070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.609260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.617685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343a69c-a199-4442-a2e7-edfc4a39ccd6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.621312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 766/1528] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.621312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.625470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.626217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.626581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.626955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.627586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ca5d5-6584-4186-9342-e15fdffbf4fb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.627836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.629916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.633304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.634021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.634303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.634575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.635326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.637249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.640839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 763/1529] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.641636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.653276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16716b65-c197-4d16-82dd-01707dc5f8c2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.657972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.658135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 767/1530] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/users => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:34.658958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.659474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.659818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.660262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] PATH_INFO: `/v3/projects/53ca37f4cac34914bcdaf6596b22f20a/users/1b653c4b85d4454f958f51ce6ae0a758/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.670011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259446b-5bb2-43bf-95ed-04b8ed59b7df admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.674435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.675185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.675471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.675593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ca37f4cac34914bcdaf6596b22f20a, user_id=1b653c4b85d4454f958f51ce6ae0a758, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.675747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.676461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.678079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.678504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.688674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 768/1531] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.688674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.696259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 764/1532] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:34 2021] PUT /identity/v3/projects/53ca37f4cac34914bcdaf6596b22f20a/users/1b653c4b85d4454f958f51ce6ae0a758/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:34.696259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.699538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196928-bc2b-4a2f-bc09-e07a2db04563 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.751049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46dc65-b99e-4238-b722-83696766a4ee admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.753631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.754591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.754834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.755133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.756734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.756930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.757053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.757298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.757572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.758097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.758579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.760201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.767936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 769/1533] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.768648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.773872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 765/1534] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.773872 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.778172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5540-ef05-4f56-b1d8-f94cf335fd40 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.782319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779321-6619-4bd9-8524-d3969c072c10 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.782519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.783260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.783485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.783757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.784466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.786044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.786837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.788139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.788424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.788703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.789426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.791019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.796093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 770/1535] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.796886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.804716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 766/1536] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.805552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.805888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3317fe-2e61-48b2-888c-755627cc7cf1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.810228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.810861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.811172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.811448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.812162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.813774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.814964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881af7d-8ae0-4d5e-953d-c4ff82c00b63 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.819888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b77b6-4596-4cea-8077-2232349353b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.820538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b77b6-4596-4cea-8077-2232349353b6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.820826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b77b6-4596-4cea-8077-2232349353b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.821105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b77b6-4596-4cea-8077-2232349353b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.821870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b77b6-4596-4cea-8077-2232349353b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.823480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b77b6-4596-4cea-8077-2232349353b6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.824554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 771/1537] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.825366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.833679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 767/1538] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.835276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6be00-e838-4d7e-8586-0f906fb1c74a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.835675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.836023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.836301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.839900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.840553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.840835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.841109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.841827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.843497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.852843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:34.853538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 772/1539] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.854033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:34.854342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.861792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 768/1540] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:34.862638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.863092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff072-e716-4203-9e38-7836de4024c6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.868660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f162-402f-4292-975d-140777df477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.869289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f162-402f-4292-975d-140777df477f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.869568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f162-402f-4292-975d-140777df477f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.869836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f162-402f-4292-975d-140777df477f admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.870549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f162-402f-4292-975d-140777df477f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.872182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f162-402f-4292-975d-140777df477f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.872309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f24508-fe82-4f5d-b7a6-45108ede885a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.877077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.877911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.878212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.878470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] PATH_INFO: `/v3/projects/590bee863c2344cab7a587988e5e3f18/users/547545bd6f4a48679cfd5b2b6acc9c25/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.883277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 773/1541] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:34.884179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f162-402f-4292-975d-140777df477f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.893764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f162-402f-4292-975d-140777df477f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.894368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=590bee863c2344cab7a587988e5e3f18, user_id=547545bd6f4a48679cfd5b2b6acc9c25, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.897714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.899218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.900094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.900378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.900649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] PATH_INFO: `/v3/projects/5087c8d7a83d4851a70414a820ea657b/users/fc7e953bfa8c4f56b8c1bc8492274cea/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:34.910208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 769/1542] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:34 2021] PUT /identity/v3/projects/590bee863c2344cab7a587988e5e3f18/users/547545bd6f4a48679cfd5b2b6acc9c25/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:34.911172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.917303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5087c8d7a83d4851a70414a820ea657b, user_id=fc7e953bfa8c4f56b8c1bc8492274cea, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:34.920428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:34.934054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 774/1543] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:34 2021] PUT /identity/v3/projects/5087c8d7a83d4851a70414a820ea657b/users/fc7e953bfa8c4f56b8c1bc8492274cea/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:34.934852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:34.977170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7143-a080-4d1e-984a-1a861648ae4c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.992610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a82b9-37e3-441d-aada-863852f0e652 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:34.996997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:34.997865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:34.998145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:34.998412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] PATH_INFO: `/v3/projects/5c2c5dcfa6be4ef1ace638c089206e15/users/b84cbe113bf545c19654aed0a6049694/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.012711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2c5dcfa6be4ef1ace638c089206e15, user_id=b84cbe113bf545c19654aed0a6049694, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.015461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.029021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 775/1544] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:34 2021] PUT /identity/v3/projects/5c2c5dcfa6be4ef1ace638c089206e15/users/b84cbe113bf545c19654aed0a6049694/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:35.029687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.034434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.035362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.035652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.035934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] PATH_INFO: `/v3/projects/1307aa8993f8425d821ec963a6bbc139/users/748fad40d4864e658ba1450dd4f90753/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.050625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1307aa8993f8425d821ec963a6bbc139, user_id=748fad40d4864e658ba1450dd4f90753, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.053281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.066316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 770/1545] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:34 2021] PUT /identity/v3/projects/1307aa8993f8425d821ec963a6bbc139/users/748fad40d4864e658ba1450dd4f90753/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:35.066888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.090780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567c03-40d4-4e6d-8d1f-5ccbb125bdd3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.128420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302039-7a82-4030-8c6b-394d48c31bbb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.134797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.135707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.135995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.136275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] PATH_INFO: `/v3/projects/73c780e58c4f4b9ebb34c8763c298d8b/users/187c1ecfe6774670b1581e9c52e7aa79/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.144782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.145695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.145979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.146256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] PATH_INFO: `/v3/projects/8fa3fbb8aff14299b4605ab0c6914d65/users/78aabd6434f34e7fb4e6ab797f808777/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.151617 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c780e58c4f4b9ebb34c8763c298d8b, user_id=187c1ecfe6774670b1581e9c52e7aa79, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.154276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.161363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa3fbb8aff14299b4605ab0c6914d65, user_id=78aabd6434f34e7fb4e6ab797f808777, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.165353 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.168054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 771/1546] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:35 2021] PUT /identity/v3/projects/73c780e58c4f4b9ebb34c8763c298d8b/users/187c1ecfe6774670b1581e9c52e7aa79/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:35.168965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.179544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 776/1547] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:35 2021] PUT /identity/v3/projects/8fa3fbb8aff14299b4605ab0c6914d65/users/78aabd6434f34e7fb4e6ab797f808777/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:35.180446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.222460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00de78-1dd4-4460-b4c3-405178974d88 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.239261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04199f0-3d16-482d-9044-b50d6118d20d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.244960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d022895-88c7-418f-a45c-82c483fd3675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.245899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022895-88c7-418f-a45c-82c483fd3675 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.246186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022895-88c7-418f-a45c-82c483fd3675 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.246460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d022895-88c7-418f-a45c-82c483fd3675 admin admin] PATH_INFO: `/v3/projects/c9ad3e7e277b44e38e556ff018a3e139/users/abce52cb36c6462c98204d6e0846857a/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.262788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022895-88c7-418f-a45c-82c483fd3675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ad3e7e277b44e38e556ff018a3e139, user_id=abce52cb36c6462c98204d6e0846857a, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.265585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d022895-88c7-418f-a45c-82c483fd3675 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.275519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2852b01-abd1-4501-b9cc-c76a0e8781f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.276178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2852b01-abd1-4501-b9cc-c76a0e8781f5 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.276459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2852b01-abd1-4501-b9cc-c76a0e8781f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.276741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2852b01-abd1-4501-b9cc-c76a0e8781f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.280082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 777/1548] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:35 2021] PUT /identity/v3/projects/c9ad3e7e277b44e38e556ff018a3e139/users/abce52cb36c6462c98204d6e0846857a/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:35.283957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7f6c-bf49-431c-85da-d21a255387e0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.283957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7f6c-bf49-431c-85da-d21a255387e0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.283957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7f6c-bf49-431c-85da-d21a255387e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.286198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2852b01-abd1-4501-b9cc-c76a0e8781f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.287741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2852b01-abd1-4501-b9cc-c76a0e8781f5 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.297117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 772/1549] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:35.298392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d9af-ab1a-4e97-9c7b-48e5481ec0be None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.298692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d9af-ab1a-4e97-9c7b-48e5481ec0be None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.299002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d9af-ab1a-4e97-9c7b-48e5481ec0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.309019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ee4b7f6c-bf49-431c-85da-d21a255387e0 None None] MFA Rules not processed for user `547545bd6f4a48679cfd5b2b6acc9c25`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.310261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ee4b7f6c-bf49-431c-85da-d21a255387e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.326119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-7837d9af-ab1a-4e97-9c7b-48e5481ec0be None None] MFA Rules not processed for user `fc7e953bfa8c4f56b8c1bc8492274cea`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.327328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7837d9af-ab1a-4e97-9c7b-48e5481ec0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.379587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 778/1550] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.382040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834b79a-51ae-409d-ad07-853762568a2f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.382396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834b79a-51ae-409d-ad07-853762568a2f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.382883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834b79a-51ae-409d-ad07-853762568a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.401771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 773/1551] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.403771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ebd6-964d-4e5b-b26e-b5e1700f03c9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.404266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ebd6-964d-4e5b-b26e-b5e1700f03c9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.404770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ebd6-964d-4e5b-b26e-b5e1700f03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.406409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0834b79a-51ae-409d-ad07-853762568a2f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.408021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0834b79a-51ae-409d-ad07-853762568a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.435844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0676ebd6-964d-4e5b-b26e-b5e1700f03c9 None None] MFA Rules not processed for user `748fad40d4864e658ba1450dd4f90753`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.437028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0676ebd6-964d-4e5b-b26e-b5e1700f03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.473653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 779/1552] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.476443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.476725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.477009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.499546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.500723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.508558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 780/1553] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.509381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.518250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e129150-c8b0-4fb1-92d5-ff142aa821eb None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.521117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 774/1554] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.522586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.522867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.523244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.523494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d08073-246a-4617-a93f-a5c61cf77e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.524164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08073-246a-4617-a93f-a5c61cf77e06 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.524455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08073-246a-4617-a93f-a5c61cf77e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.524731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08073-246a-4617-a93f-a5c61cf77e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.525484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d08073-246a-4617-a93f-a5c61cf77e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.527145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d08073-246a-4617-a93f-a5c61cf77e06 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.539198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 781/1555] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:35.540674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79481ac4-05bd-4bdd-b248-b75afad27814 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.540967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79481ac4-05bd-4bdd-b248-b75afad27814 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.541251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79481ac4-05bd-4bdd-b248-b75afad27814 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.543379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 782/1556] 10.222.0.66 () {54 vars in 961 bytes} [Tue Jul 13 08:40:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:40:35.548440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79481ac4-05bd-4bdd-b248-b75afad27814 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.549331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.550734 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.560086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 775/1557] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.561172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.561309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79481ac4-05bd-4bdd-b248-b75afad27814 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.565951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.566733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.567169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.567547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.569058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.571578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.601009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 783/1558] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:35.602433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.619749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615970a-94d3-4426-945f-b0fa37da6430 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.671465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ad5e5-7443-4e28-8d10-8858876bde6e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.674202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da87f1c-0fa6-463b-b0c8-a1455877731d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.674866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da87f1c-0fa6-463b-b0c8-a1455877731d service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.675186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da87f1c-0fa6-463b-b0c8-a1455877731d service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.677142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.678530 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.678730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.679095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.679205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da87f1c-0fa6-463b-b0c8-a1455877731d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.750292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.751518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da87f1c-0fa6-463b-b0c8-a1455877731d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.752009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.753150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da87f1c-0fa6-463b-b0c8-a1455877731d service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.763414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 776/1559] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:35.764771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523a67-5bad-4283-90df-fe1c737ac9fd None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.765056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523a67-5bad-4283-90df-fe1c737ac9fd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.765331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523a67-5bad-4283-90df-fe1c737ac9fd None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.766950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 784/1560] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:35.767439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 777/1561] 10.222.0.66 () {54 vars in 961 bytes} [Tue Jul 13 08:40:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:40:35.767845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.768677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.768961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.769236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.778341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9633d3-97eb-4171-b1ec-53b8e765416d service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.783182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.784103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.784382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.784654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] PATH_INFO: `/v3/projects/8fa3fbb8aff14299b4605ab0c6914d65/users/78aabd6434f34e7fb4e6ab797f808777/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.786574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa3fbb8aff14299b4605ab0c6914d65, user_id=78aabd6434f34e7fb4e6ab797f808777, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.788443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.789597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:35.790232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.803345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 785/1562] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:35 2021] PUT /identity/v3/projects/8fa3fbb8aff14299b4605ab0c6914d65/users/78aabd6434f34e7fb4e6ab797f808777/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:35.804397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.872355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede04e-61bf-46b6-8096-36346d9ec548 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.874268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 778/1563] 10.222.0.66 () {58 vars in 1059 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:35.874855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:35.876556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae1722-7184-48ee-8f74-9d9e4360bb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.877146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1722-7184-48ee-8f74-9d9e4360bb0e service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.877444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1722-7184-48ee-8f74-9d9e4360bb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.877796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae1722-7184-48ee-8f74-9d9e4360bb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.886721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca348c60-1144-493d-9adf-da8a1612cec0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:35.948759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae1722-7184-48ee-8f74-9d9e4360bb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.950976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae1722-7184-48ee-8f74-9d9e4360bb0e service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.955967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f7b9-289b-4c0c-ba56-bb520adc4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:35.956643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f7b9-289b-4c0c-ba56-bb520adc4543 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.956917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f7b9-289b-4c0c-ba56-bb520adc4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.957215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f7b9-289b-4c0c-ba56-bb520adc4543 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.957896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f7b9-289b-4c0c-ba56-bb520adc4543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:35.960565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f7b9-289b-4c0c-ba56-bb520adc4543 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:35.963234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 786/1564] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:35.964862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.965359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.965796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.984329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 779/1565] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:35.985772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:35.986226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:35.987029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:35.993250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:35.994417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:36.019609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] MFA Rules not processed for user `78aabd6434f34e7fb4e6ab797f808777`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:36.020879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:36.072035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 787/1566] 10.222.0.66 () {58 vars in 1059 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:36.073370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.085010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b2d63-8b54-4136-9b49-e9ffaea1374c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.091323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.092155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.092433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.092775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.097674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 780/1567] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:35 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:36.098694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.110101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d80178-ee27-4c47-83a1-a60e3404b4e9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.120149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.120830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.121110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.121384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.122131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.123999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.135419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 781/1568] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:36.139720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.153624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1c786-be24-4523-9895-b6c4db93994c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.158795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.159635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.159920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.160192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.160359 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.162261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.172611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 788/1569] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:36.173597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.221092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.222743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.232961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 782/1570] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:36.233761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.245122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46d299-4d4d-4640-a771-6474ed9a7490 service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.249128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.250415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.250415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.250644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] PATH_INFO: `/v3/projects/f434f41182a443ddaccc68a31cde7ce3/users/a6b1b83c00cb49b7b43ca629328420ce/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.256150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1ac05-798b-40c0-8ff5-3bea485f1d58 service nova] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.260831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.262032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.262582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.263494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.266621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f434f41182a443ddaccc68a31cde7ce3, user_id=a6b1b83c00cb49b7b43ca629328420ce, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.269420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.276532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.280415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.291288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 789/1571] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:36.291587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 783/1572] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:36 2021] PUT /identity/v3/projects/f434f41182a443ddaccc68a31cde7ce3/users/a6b1b83c00cb49b7b43ca629328420ce/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:36.295638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.312847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff273b-46c2-42fc-96b6-408488c737ec service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.395255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.413938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.414862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.415314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.415757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.416682 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.418503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.438023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 790/1573] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:36.438874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.466531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f04bf-dfeb-4358-9d69-8780bbc5a82b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.477681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd9b7-5130-4915-b48b-49b0e777ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.479349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd9b7-5130-4915-b48b-49b0e777ee3d admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.481088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd9b7-5130-4915-b48b-49b0e777ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.482166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd9b7-5130-4915-b48b-49b0e777ee3d admin admin] PATH_INFO: `/v3/projects/f434f41182a443ddaccc68a31cde7ce3/users/a6b1b83c00cb49b7b43ca629328420ce/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.484900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bd9b7-5130-4915-b48b-49b0e777ee3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f434f41182a443ddaccc68a31cde7ce3, user_id=a6b1b83c00cb49b7b43ca629328420ce, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.489906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bd9b7-5130-4915-b48b-49b0e777ee3d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.491828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaddbf-37da-4c1a-acd3-6c5dcf983cc7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:36.497023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776cedc-5b88-4d48-a1e5-8bc4b6283d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:36.504565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776cedc-5b88-4d48-a1e5-8bc4b6283d0d service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.505041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776cedc-5b88-4d48-a1e5-8bc4b6283d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.505361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776cedc-5b88-4d48-a1e5-8bc4b6283d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.506183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 791/1574] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:36 2021] PUT /identity/v3/projects/f434f41182a443ddaccc68a31cde7ce3/users/a6b1b83c00cb49b7b43ca629328420ce/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:36.507745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4837d8-a1eb-4138-ae44-6b7d11ec91d6 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.508042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4837d8-a1eb-4138-ae44-6b7d11ec91d6 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.508854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4837d8-a1eb-4138-ae44-6b7d11ec91d6 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.512017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 792/1575] 10.222.0.66 () {54 vars in 912 bytes} [Tue Jul 13 08:40:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:40:36.539617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552d663-49cb-4b2f-b8af-e3785be7de53 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.541926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552d663-49cb-4b2f-b8af-e3785be7de53 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.542637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552d663-49cb-4b2f-b8af-e3785be7de53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.596049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9552d663-49cb-4b2f-b8af-e3785be7de53 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:36.597961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9552d663-49cb-4b2f-b8af-e3785be7de53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:36.647455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776cedc-5b88-4d48-a1e5-8bc4b6283d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:36.648875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776cedc-5b88-4d48-a1e5-8bc4b6283d0d service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:36.661199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 784/1576] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:36.663312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe044a4-606e-4038-9f6b-a4259a2168af None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.664123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe044a4-606e-4038-9f6b-a4259a2168af None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.664571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe044a4-606e-4038-9f6b-a4259a2168af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.707222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2fe044a4-606e-4038-9f6b-a4259a2168af None None] MFA Rules not processed for user `a6b1b83c00cb49b7b43ca629328420ce`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:36.710225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2fe044a4-606e-4038-9f6b-a4259a2168af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:36.760946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 793/1577] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:40:36 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:36.764389 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625f2fa-e5df-422a-bf70-b4dba14aa9cc None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.764731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625f2fa-e5df-422a-bf70-b4dba14aa9cc None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.765650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625f2fa-e5df-422a-bf70-b4dba14aa9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.807368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-2625f2fa-e5df-422a-bf70-b4dba14aa9cc None None] MFA Rules not processed for user `1b653c4b85d4454f958f51ce6ae0a758`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:36.808759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2625f2fa-e5df-422a-bf70-b4dba14aa9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:36.882834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 785/1578] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:36 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:36.884837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368169-ffc6-4458-959d-062f2645eff5 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.885214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368169-ffc6-4458-959d-062f2645eff5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.885602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368169-ffc6-4458-959d-062f2645eff5 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.893556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 786/1579] 10.222.0.66 () {54 vars in 912 bytes} [Tue Jul 13 08:40:36 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:40:36.898152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61368169-ffc6-4458-959d-062f2645eff5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:36.928479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 794/1580] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:36 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:36.930309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ce64-4ad0-402f-859c-eaaae4260891 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:36.930611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ce64-4ad0-402f-859c-eaaae4260891 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:36.930889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ce64-4ad0-402f-859c-eaaae4260891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:36.999550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d8b0ce64-4ad0-402f-859c-eaaae4260891 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:37.001728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d8b0ce64-4ad0-402f-859c-eaaae4260891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:37.021611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 795/1581] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:40:36 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:37.025644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.026501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.026787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.050800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61368169-ffc6-4458-959d-062f2645eff5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:37.060128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f164de-8da7-41af-97ca-90c866ac2809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:37.060559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f164de-8da7-41af-97ca-90c866ac2809 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.060851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f164de-8da7-41af-97ca-90c866ac2809 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.061460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f164de-8da7-41af-97ca-90c866ac2809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.065567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] MFA Rules not processed for user `1b653c4b85d4454f958f51ce6ae0a758`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:37.066770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:37.075317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 796/1582] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:37 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:37.076248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:37.082402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f164de-8da7-41af-97ca-90c866ac2809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:37.083958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f164de-8da7-41af-97ca-90c866ac2809 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:37.086607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4803e2-ba9c-47b5-a04b-222fc034f54b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:37.091210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:37.091891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.092413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.093001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.117704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 787/1583] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:37.219238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:37.229518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:37.248073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 797/1584] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:37 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:37.532907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2888-255c-409c-ba52-4a9be5223c74 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.533379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2888-255c-409c-ba52-4a9be5223c74 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.533608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2888-255c-409c-ba52-4a9be5223c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.592573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-380c2888-255c-409c-ba52-4a9be5223c74 None None] MFA Rules not processed for user `b84cbe113bf545c19654aed0a6049694`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:37.593867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-380c2888-255c-409c-ba52-4a9be5223c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:37.737811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 788/1585] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:37 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:37.765955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:37.792203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02c2ba-d1f9-411b-81d2-7c704e9020f5 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:37.801937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:37.803105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.803980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.804115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.804209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.806404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.806659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.837785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] MFA Rules not processed for user `b84cbe113bf545c19654aed0a6049694`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:37.838826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:37.839164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:37.840328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:37.862508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 789/1586] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:37 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:37.878138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 798/1587] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:37.942813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:37.962115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83e27-e26c-4245-a414-798f15f9886a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:37.979761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc7ca-e3a3-405b-9542-dbe36c8949bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:37.980449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc7ca-e3a3-405b-9542-dbe36c8949bb service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:37.980737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc7ca-e3a3-405b-9542-dbe36c8949bb service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:37.981025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc7ca-e3a3-405b-9542-dbe36c8949bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:37.990937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc7ca-e3a3-405b-9542-dbe36c8949bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:37.992762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc7ca-e3a3-405b-9542-dbe36c8949bb service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:38.016050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 790/1588] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:37 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:38.037716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:38.053519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e15c7-c2b0-4e6e-8d78-3b8749d9facb service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:38.067859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dcd84-08e5-4e8b-a241-e328c832442a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:38.069345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcd84-08e5-4e8b-a241-e328c832442a service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.069470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcd84-08e5-4e8b-a241-e328c832442a service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.069751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcd84-08e5-4e8b-a241-e328c832442a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:38.098010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dcd84-08e5-4e8b-a241-e328c832442a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:38.098828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dcd84-08e5-4e8b-a241-e328c832442a service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:38.111788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 799/1589] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:38 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:38.591547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690866-1064-41dd-a40b-36d5ae44a84a None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.592083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690866-1064-41dd-a40b-36d5ae44a84a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.592194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690866-1064-41dd-a40b-36d5ae44a84a None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:38.594105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 791/1590] 10.222.0.66 () {54 vars in 912 bytes} [Tue Jul 13 08:40:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:40:38.600618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8c14-570c-4476-88f7-cbe89718b7f3 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.600906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8c14-570c-4476-88f7-cbe89718b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.601231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8c14-570c-4476-88f7-cbe89718b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:38.641453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a83c8c14-570c-4476-88f7-cbe89718b7f3 None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:38.642747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a83c8c14-570c-4476-88f7-cbe89718b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:38.696557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 800/1591] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:40:38 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:38.708192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6690866-1064-41dd-a40b-36d5ae44a84a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:38.726022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6690866-1064-41dd-a40b-36d5ae44a84a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:38.726022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f48d1-15e9-47b0-837d-27b4c5993ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:38.726022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f48d1-15e9-47b0-837d-27b4c5993ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.726022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f48d1-15e9-47b0-837d-27b4c5993ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.727663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f48d1-15e9-47b0-837d-27b4c5993ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:38.732799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f48d1-15e9-47b0-837d-27b4c5993ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:38.734330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f48d1-15e9-47b0-837d-27b4c5993ee1 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:38.742760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 792/1592] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:38 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:38.911537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eacab6-c4cb-4cab-8aba-8da5a717fb92 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.911878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eacab6-c4cb-4cab-8aba-8da5a717fb92 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.912749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eacab6-c4cb-4cab-8aba-8da5a717fb92 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:38.915076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 801/1593] 10.222.0.66 () {54 vars in 912 bytes} [Tue Jul 13 08:40:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:40:38.920604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.920974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.921335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:38.941718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:38.943136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:38.960724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 793/1594] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:40:38 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:38.978491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eacab6-c4cb-4cab-8aba-8da5a717fb92 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:38.991515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eacab6-c4cb-4cab-8aba-8da5a717fb92 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:38.995424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:38.996545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:38.998488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:38.998488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:39.005352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:39.007762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:39.016698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 802/1595] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:38 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:39.325673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:39.456597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557d7e0-0f24-4713-83f8-a56695a77acf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:39.476460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:39.478991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:39.479354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:39.479706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:39.483750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:39.519343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:39.519343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806ab2-5455-4c06-a21d-90946c12b4f0 service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:39.571368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 794/1596] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:39 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:39.953600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:40.023155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca719b8-1b2c-4c5e-b5e9-ff1d284d92b1 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:40.024189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca719b8-1b2c-4c5e-b5e9-ff1d284d92b1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:40.024663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca719b8-1b2c-4c5e-b5e9-ff1d284d92b1 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:40.026881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 795/1597] 10.222.0.66 () {54 vars in 960 bytes} [Tue Jul 13 08:40:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:40:40.032637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:40.033187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:40.033684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:40.076801 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] MFA Rules not processed for user `056919d757294178b647759f5c9809c1`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:40.078478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:40.093100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 796/1598] 10.222.0.66 () {58 vars in 1058 bytes} [Tue Jul 13 08:40:40 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:40.114426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:40.135822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a98a4-03ad-4edc-9f93-11c98aa645b0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:40.136028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd28cd2-1c9d-44cb-a3fc-e9d77ccd3edf service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:40.148553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:40.150760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:40.151368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:40.151820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] PATH_INFO: `/v3/users/748fad40d4864e658ba1450dd4f90753` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:40.153363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=748fad40d4864e658ba1450dd4f90753)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:40.156323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:40.157950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:40.158400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:40.159430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:40.161906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:40.162430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: WARNING py.warnings [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:40:40.162430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: warnings.warn(msg) Jul 13 08:40:40.162430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: Jul 13 08:40:40.174265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:40.178451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:40.181155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226018e-04f4-42e4-9349-7acba66141ff service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:40.193889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 797/1599] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:40 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:40.416215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748fad40d4864e658ba1450dd4f90753'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:40.418296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748fad40d4864e658ba1450dd4f90753'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:40.434820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748fad40d4864e658ba1450dd4f90753'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:40.462194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748fad40d4864e658ba1450dd4f90753'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:40.463889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748fad40d4864e658ba1450dd4f90753'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:40.516100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 803/1600] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:40:39 2021] DELETE /identity/v3/users/748fad40d4864e658ba1450dd4f90753 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:40.521009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:40.521580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:40.522061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:40.556890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:40.568435 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:40.703307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 798/1601] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:40.817597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:40.820098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:40.929638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a825c9a-7fef-486d-9706-303df6a18349 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:40.934229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf979-e428-4c4b-b7fd-4b0ddfad022c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:40.935305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf979-e428-4c4b-b7fd-4b0ddfad022c service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:40.936775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf979-e428-4c4b-b7fd-4b0ddfad022c service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:40.937362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf979-e428-4c4b-b7fd-4b0ddfad022c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:40.949339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf979-e428-4c4b-b7fd-4b0ddfad022c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:40.951652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf979-e428-4c4b-b7fd-4b0ddfad022c service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:40.965092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 804/1602] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:41.959579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:41.961633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:41.978514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fa102-da14-4f46-8d63-e56124409a6c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:41.989138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:41.990247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:41.990721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:41.991332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] PATH_INFO: `/v3/projects/1307aa8993f8425d821ec963a6bbc139` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:41.993372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1307aa8993f8425d821ec963a6bbc139)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:41.997876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: WARNING py.warnings [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 08:40:41.997876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: warnings.warn(msg) Jul 13 08:40:41.997876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: Jul 13 08:40:42.001122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:42.131376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1307aa8993f8425d821ec963a6bbc139', 'request_id': 'req-85233b25-bc6e-43f8-9942-d01ca73e2780'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:42.147029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1307aa8993f8425d821ec963a6bbc139', 'request_id': 'req-85233b25-bc6e-43f8-9942-d01ca73e2780'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:42.164354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1307aa8993f8425d821ec963a6bbc139', 'request_id': 'req-85233b25-bc6e-43f8-9942-d01ca73e2780'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:42.205931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] The token cache is being invalidate because project 1307aa8993f8425d821ec963a6bbc139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:40:42.206577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:42.210031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85233b25-bc6e-43f8-9942-d01ca73e2780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:42.212658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 799/1603] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:40:41 2021] DELETE /identity/v3/projects/1307aa8993f8425d821ec963a6bbc139 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:42.219116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.219634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.219748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.298294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:42.302242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:42.479011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 805/1604] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:42.534155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.534335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.534513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.556406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:42.557880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:42.573753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:42.580593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 800/1605] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:42.584852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f30b-24d3-4f51-ac30-64b0646d5b67 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:42.597488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:42.599059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.600339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.601156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.603437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:42.604014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:42.605995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:42.626083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:42.633446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 806/1606] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:42.638234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b820d7b-d06c-432e-9fa9-369c2d4f8672 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:42.643979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:42.645167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.645553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.645931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.648372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:42.651393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:42.707098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:42.708047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 801/1607] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:42 2021] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:40:42.720011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39894e26-f9d0-467e-b4b5-83c38e9a3450 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:42.817265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:42.818482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.819497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.819497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.819937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:42.835722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:42.866814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 807/1608] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:42 2021] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:40:42.868582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:42.885536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c399a-7009-43ea-8d4c-7abdec218bfe admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:42.899465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:42.900579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.901690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.902594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.903994 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:42.908471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:42.937257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 802/1609] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:42 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:42.938497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:42.951675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fcfd5-6a2a-463a-9837-ae479a35441d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:42.966837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1bffa-5f91-452a-a902-e4e5c00ce03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:42.967718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1bffa-5f91-452a-a902-e4e5c00ce03b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:42.967988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1bffa-5f91-452a-a902-e4e5c00ce03b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:42.969583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1bffa-5f91-452a-a902-e4e5c00ce03b admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:42.970354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1bffa-5f91-452a-a902-e4e5c00ce03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:42.977490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1bffa-5f91-452a-a902-e4e5c00ce03b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:43.005571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 808/1610] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:42 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:43.010107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:43.024874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea83ef-dc70-46fc-941a-256c8997217b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:43.035557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:43.040249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:43.040908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:43.042616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] PATH_INFO: `/v3/projects/103e1ff4a36c4ff69857fdc47fd71adf/users/48663ff6c6934df885e13816c53f92b7/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:43.077939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] RBAC: Authorizing `identity:create_grant(project_id=103e1ff4a36c4ff69857fdc47fd71adf, user_id=48663ff6c6934df885e13816c53f92b7, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:43.086290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:43.114559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 803/1611] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:43 2021] PUT /identity/v3/projects/103e1ff4a36c4ff69857fdc47fd71adf/users/48663ff6c6934df885e13816c53f92b7/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:43.120183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:43.120495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:43.120776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:43.161177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:43.166203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:43.319872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 809/1612] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:43.358271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:43.360391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:43.492082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5f47-31d7-432b-9a41-0c986ae2568c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:43.508384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c96b-2260-4056-9011-653d815731d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:43.510951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c96b-2260-4056-9011-653d815731d3 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:43.511420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c96b-2260-4056-9011-653d815731d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:43.513561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c96b-2260-4056-9011-653d815731d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:43.535116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c96b-2260-4056-9011-653d815731d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:43.538016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c96b-2260-4056-9011-653d815731d3 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:43.551596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 804/1613] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:43.859291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:43.861102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:44.007395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365ac8f-dc1f-4284-83ec-2e370a7788ae None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:44.015091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:44.015976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:44.016600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:44.017058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:44.020474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:44.142817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:44.144426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff9627-79cb-4f25-8b5c-9e9114349bae service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:44.156013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 810/1614] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:43 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:45.693443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:45.693875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:45.693997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:45.736156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6b21-8df5-42e9-aee9-6455269c6812 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:45.736622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6b21-8df5-42e9-aee9-6455269c6812 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:45.736791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6b21-8df5-42e9-aee9-6455269c6812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:45.791992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] MFA Rules not processed for user `187c1ecfe6774670b1581e9c52e7aa79`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:45.793470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:45.813789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-96ed6b21-8df5-42e9-aee9-6455269c6812 None None] MFA Rules not processed for user `48663ff6c6934df885e13816c53f92b7`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:45.817651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-96ed6b21-8df5-42e9-aee9-6455269c6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:46.004676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 805/1615] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:46.054293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 811/1616] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:45 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:46.060165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.096028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.096028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.096303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.098957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bf5f2-3599-4482-8f51-e22a09f55988 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:46.112926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:46.113835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.114302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.115659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.116579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:46.120871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:46.151058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] MFA Rules not processed for user `187c1ecfe6774670b1581e9c52e7aa79`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:46.158842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:46.168745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 806/1617] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:46 2021] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:46.172526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.183548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 812/1618] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:46.196109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.198005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:46.341894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8296-72ed-41f0-b2e4-5418d88f6635 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:46.354591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc573e-7890-4f6c-bf32-99f8fa141587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:46.356475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc573e-7890-4f6c-bf32-99f8fa141587 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.356987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc573e-7890-4f6c-bf32-99f8fa141587 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.357498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc573e-7890-4f6c-bf32-99f8fa141587 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.359760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc573e-7890-4f6c-bf32-99f8fa141587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:46.362746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc573e-7890-4f6c-bf32-99f8fa141587 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:46.392600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d877618-d06e-4137-84e6-51de144ef295 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:46.427663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 807/1619] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:46 2021] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:46.434753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.436259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.436784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.503301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] MFA Rules not processed for user `abce52cb36c6462c98204d6e0846857a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:46.508003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:46.633579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:46.634876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.635489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.635714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.706485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 808/1620] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:46 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:46.709012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.720235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad55144-9827-44e5-a7d0-8b95addc9990 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:46.725954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:46.726657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.726962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.727412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.728475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:46.730089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:46.745670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 809/1621] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:46.762343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.781107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69030b7a-3733-4e81-81c9-0decf254ce98 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:46.789711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:46.791446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.791807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.792333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] PATH_INFO: `/v3/projects/110fb177004e4ecdac08264077fb091c/users/92a17e87cd544c4aa7123bc81c6e5749/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.793556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:46.796788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:46.808292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 813/1622] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:46 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:40:46.815247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=110fb177004e4ecdac08264077fb091c, user_id=92a17e87cd544c4aa7123bc81c6e5749, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:46.820057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:46.844244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 810/1623] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:46 2021] PUT /identity/v3/projects/110fb177004e4ecdac08264077fb091c/users/92a17e87cd544c4aa7123bc81c6e5749/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:46.848571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.868538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42144b-9f88-4e61-811f-c405a3cbb464 service nova] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:46.919216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:46.922045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:46.989344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:46.990103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:46.990377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:46.990717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:46.991543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:46.993317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:47.008051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 814/1624] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:46 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:47.013424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:47.025258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20330-0eb5-45b0-8cba-e2fdd819f914 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:47.040164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:47.041082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:47.041380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:47.041644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] PATH_INFO: `/v3/projects/110fb177004e4ecdac08264077fb091c/users/92a17e87cd544c4aa7123bc81c6e5749/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:47.043834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110fb177004e4ecdac08264077fb091c, user_id=92a17e87cd544c4aa7123bc81c6e5749, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:47.046772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:47.072041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 815/1625] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:47 2021] PUT /identity/v3/projects/110fb177004e4ecdac08264077fb091c/users/92a17e87cd544c4aa7123bc81c6e5749/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:40:47.100914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662429-5bb4-47f2-b735-a6a301b5eefa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:47.270368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7f604-b226-448a-a38f-717b15885013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:47.272920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f604-b226-448a-a38f-717b15885013 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:47.273353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f604-b226-448a-a38f-717b15885013 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:47.273836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f604-b226-448a-a38f-717b15885013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:47.391843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7f604-b226-448a-a38f-717b15885013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:47.395141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7f604-b226-448a-a38f-717b15885013 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:47.417304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 811/1626] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:46 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:47.899828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:47.901624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:48.088496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ccc2d-cd75-4d21-9819-d02375c3de99 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:48.108928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793c02-35ef-4e76-bfd4-216967263800 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:48.109868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793c02-35ef-4e76-bfd4-216967263800 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:48.110311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793c02-35ef-4e76-bfd4-216967263800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:48.114165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:48.115724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:48.122294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:48.122568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] PATH_INFO: `/v3/users/547545bd6f4a48679cfd5b2b6acc9c25` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:48.128091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=547545bd6f4a48679cfd5b2b6acc9c25)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:48.133150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:48.155987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-cc793c02-35ef-4e76-bfd4-216967263800 None None] MFA Rules not processed for user `187c1ecfe6774670b1581e9c52e7aa79`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:48.157174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cc793c02-35ef-4e76-bfd4-216967263800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:48.249254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547545bd6f4a48679cfd5b2b6acc9c25'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:48.250493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547545bd6f4a48679cfd5b2b6acc9c25'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:48.265161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547545bd6f4a48679cfd5b2b6acc9c25'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:48.287093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547545bd6f4a48679cfd5b2b6acc9c25'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:48.288392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547545bd6f4a48679cfd5b2b6acc9c25'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:48.329525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 812/1627] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:48 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:48.340375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 816/1628] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:40:47 2021] DELETE /identity/v3/users/547545bd6f4a48679cfd5b2b6acc9c25 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:48.350779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680dad-d7d4-4f32-bc1c-795c555ba8bd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:48.351145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680dad-d7d4-4f32-bc1c-795c555ba8bd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:48.351375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680dad-d7d4-4f32-bc1c-795c555ba8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:48.395178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-28680dad-d7d4-4f32-bc1c-795c555ba8bd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:48.397601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-28680dad-d7d4-4f32-bc1c-795c555ba8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:48.615586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 813/1629] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:48.649981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:48.652340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:48.821899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c75bb-6e03-484c-a84b-4673caa11935 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:48.822128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e16e-3480-418f-a03e-6531f22a3d2c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:48.822556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c75bb-6e03-484c-a84b-4673caa11935 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:48.824248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c75bb-6e03-484c-a84b-4673caa11935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:48.832358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:48.833372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:48.834990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:48.835603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:48.860116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:48.861875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-790c75bb-6e03-484c-a84b-4673caa11935 None None] MFA Rules not processed for user `92a17e87cd544c4aa7123bc81c6e5749`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:48.862155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:48.863173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-790c75bb-6e03-484c-a84b-4673caa11935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:48.888233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 817/1630] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:49.030228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 814/1631] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:48 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:50.147919 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:50.150099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:50.191282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c03d24-5ac0-4210-be40-2e7d28864fa4 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:50.215011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:50.216278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:50.216569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:50.216849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] PATH_INFO: `/v3/projects/590bee863c2344cab7a587988e5e3f18` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:50.220788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] RBAC: Authorizing `identity:delete_project(project_id=590bee863c2344cab7a587988e5e3f18)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:50.222769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:50.412493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590bee863c2344cab7a587988e5e3f18', 'request_id': 'req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:50.426835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590bee863c2344cab7a587988e5e3f18', 'request_id': 'req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:50.440136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590bee863c2344cab7a587988e5e3f18', 'request_id': 'req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:50.465274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] The token cache is being invalidate because project 590bee863c2344cab7a587988e5e3f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:40:50.465763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:50.466480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1147ad8a-2605-46a4-bbbd-1eb2b31d732d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:50.468417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 818/1632] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:40:50 2021] DELETE /identity/v3/projects/590bee863c2344cab7a587988e5e3f18 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:50.474935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b84a-750c-462a-a853-e75e494175f4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:50.475696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b84a-750c-462a-a853-e75e494175f4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:50.475696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b84a-750c-462a-a853-e75e494175f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:50.543941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9872b84a-750c-462a-a853-e75e494175f4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:50.544459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9872b84a-750c-462a-a853-e75e494175f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:50.895258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 815/1633] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:50.897745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:50.898158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:50.898535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:50.934377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:50.936059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:50.966487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:50.966778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:50.967264 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.000909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:51.002457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:51.021607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 816/1634] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:51.023058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.035205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d778c6c-14fa-48f5-b0e5-26df724deebc None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.044181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.044947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.045608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.047405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.048218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:51.049379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:51.055193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:51.076221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 819/1635] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:40:50 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:40:51.085791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.087328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 817/1636] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:51.100887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50137c14-0b46-4035-8742-10f38f209b9b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.114245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.115975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.124468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.125811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.131829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:51.143238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:51.234724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 820/1637] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:51 2021] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:51.240887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.266533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045c9f5-abff-4e86-9479-b8575170b13e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.319414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.321995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:51.502879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871444-7f53-4033-b1e0-29485bd9941f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.520597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.521305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.522148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.523132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.523132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.528989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.530721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.531450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.532486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:51.535142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:51.600505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 818/1638] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:51 2021] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:51.616761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.648120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb46f6-3277-4ff6-9db6-07bfa30152db admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.666272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.666999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.667402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.668549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.669016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:51.674643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:51.676260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:51.679517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:51.713184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 819/1639] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:51 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:51.733101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.738590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 821/1640] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:40:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 08:40:51.778977 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74304-cd8c-4851-bf8b-d61bf7224db2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.797202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372670-1a5e-4748-ac5f-a88dfd8089e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.799775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372670-1a5e-4748-ac5f-a88dfd8089e8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.803324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372670-1a5e-4748-ac5f-a88dfd8089e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.803731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372670-1a5e-4748-ac5f-a88dfd8089e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.806429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372670-1a5e-4748-ac5f-a88dfd8089e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:51.810100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372670-1a5e-4748-ac5f-a88dfd8089e8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:51.834548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 820/1641] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:51 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:51.836829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:51.858969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976cd3-78ed-44b7-806f-fbf24f1374c4 service swift] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:51.874129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:51.882539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:51.883665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:51.885874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] PATH_INFO: `/v3/projects/8eb011670edb4fe28045ad41de9e0949/users/07f2075dbc984612aa74bdd637a3bf5d/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:51.979778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb011670edb4fe28045ad41de9e0949, user_id=07f2075dbc984612aa74bdd637a3bf5d, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:52.001553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:52.086293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 822/1642] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:51 2021] PUT /identity/v3/projects/8eb011670edb4fe28045ad41de9e0949/users/07f2075dbc984612aa74bdd637a3bf5d/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:52.101011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:52.101490 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:52.101776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:52.182388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] MFA Rules not processed for user `07f2075dbc984612aa74bdd637a3bf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:52.183767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:52.447615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 821/1643] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:52 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:52.452174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:52.763786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0202a-df8d-4c2a-9761-2a95a4dfb66d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:52.788996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:52.793547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:52.797298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:52.797704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:52.799788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:52.809176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:52.907824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 823/1644] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:52 2021] POST /identity/v3/projects => generated 371 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:40:52.912674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:52.934315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9208-f9b0-4f5c-a0af-2dde2e5aa10d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:53.129542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:53.133309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.134417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.134851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.140210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:53.147887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:53.226782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 822/1645] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:52 2021] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:53.231721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:53.262122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b92f-ba87-43ea-bf6e-f364aed266be admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:53.275113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:53.275865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.276314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.283059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.284308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:53.286195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:53.310849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 824/1646] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:53 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:40:53.315783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:53.345096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1d48-b912-4fcf-831b-a552904e29e1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:53.351344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:53.352613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.353260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.353724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] PATH_INFO: `/v3/projects/f1512985412a4145ad2c7717a6492ca4/users/bdc45d74905c441e8d1fbf1953ea813d/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.379129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1512985412a4145ad2c7717a6492ca4, user_id=bdc45d74905c441e8d1fbf1953ea813d, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:53.383387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:53.455220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 823/1647] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:53 2021] PUT /identity/v3/projects/f1512985412a4145ad2c7717a6492ca4/users/bdc45d74905c441e8d1fbf1953ea813d/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:53.455322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:53.463845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b5c24-9c6b-4a97-ab04-45adf1250f08 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:53.569454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:53.571772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:53.603420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:53.604110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.604572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.604869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.605599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:53.608843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:53.631993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 825/1648] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:53 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:53.636297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:53.659298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0058ed5-b09d-4ea9-b161-4cc45ac6de58 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:53.671960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d893f88-a7ed-4f19-b8d8-379a0e70c8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:53.674145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d893f88-a7ed-4f19-b8d8-379a0e70c8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.674145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d893f88-a7ed-4f19-b8d8-379a0e70c8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.674356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d893f88-a7ed-4f19-b8d8-379a0e70c8eb admin admin] PATH_INFO: `/v3/projects/f1512985412a4145ad2c7717a6492ca4/users/bdc45d74905c441e8d1fbf1953ea813d/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.678164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d893f88-a7ed-4f19-b8d8-379a0e70c8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1512985412a4145ad2c7717a6492ca4, user_id=bdc45d74905c441e8d1fbf1953ea813d, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:53.683238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d893f88-a7ed-4f19-b8d8-379a0e70c8eb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:53.718317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4aa9-f4d4-4226-bef9-b0a82150a00a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:53.718543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 826/1649] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:53 2021] PUT /identity/v3/projects/f1512985412a4145ad2c7717a6492ca4/users/bdc45d74905c441e8d1fbf1953ea813d/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:53.721956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.722379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.722750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.768688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] MFA Rules not processed for user `bdc45d74905c441e8d1fbf1953ea813d`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:53.771694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:53.865709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:53.896393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:53.896393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:53.901381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] PATH_INFO: `/v3/users/48663ff6c6934df885e13816c53f92b7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:53.910748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48663ff6c6934df885e13816c53f92b7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:53.916209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:53.966372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 827/1650] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:53 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:53.979841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:53.991515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:54.064055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48663ff6c6934df885e13816c53f92b7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:54.075071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48663ff6c6934df885e13816c53f92b7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:54.076133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48663ff6c6934df885e13816c53f92b7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:54.124658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48663ff6c6934df885e13816c53f92b7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:54.143772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48663ff6c6934df885e13816c53f92b7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:54.175030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa0e20-b4cb-401e-b7c7-048f8148ceee None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:54.186056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 824/1651] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:40:53 2021] DELETE /identity/v3/users/48663ff6c6934df885e13816c53f92b7 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:54.305310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:54.307456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:54.308346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:54.309826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:54.313736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:54.424202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:54.427168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f205f9c-1c04-448b-98d3-e786ea02266f service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:54.443280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 828/1652] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:53 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:54.569773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:54.571295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:54.600448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35bdb-4c15-4f5d-9640-2e9ea297ea47 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:54.620648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:54.622482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:54.622819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:54.623200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:54.625537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:54.739417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:54.740119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:54.740119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:54.767922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] MFA Rules not processed for user `abce52cb36c6462c98204d6e0846857a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:54.769569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:54.811442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:54.816175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:54.827770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 825/1653] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:54 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:54.829230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:54.830734 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:54.894409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 829/1654] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:54 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:54.941275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f341a4-735d-4cd1-8fe1-e6049eadce7e service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:54.947076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:54.948342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:54.948632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:54.948959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] PATH_INFO: `/v3/projects/103e1ff4a36c4ff69857fdc47fd71adf` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:54.951803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103e1ff4a36c4ff69857fdc47fd71adf)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:54.954023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:55.046059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103e1ff4a36c4ff69857fdc47fd71adf', 'request_id': 'req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.052575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103e1ff4a36c4ff69857fdc47fd71adf', 'request_id': 'req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.061713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103e1ff4a36c4ff69857fdc47fd71adf', 'request_id': 'req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.076857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] The token cache is being invalidate because project 103e1ff4a36c4ff69857fdc47fd71adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:40:55.077259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.077968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.079931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 826/1655] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:40:54 2021] DELETE /identity/v3/projects/103e1ff4a36c4ff69857fdc47fd71adf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:55.084119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:55.095757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f272-5887-4709-b923-b2e64aa02740 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:55.206729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:55.207978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:55.209082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:55.209529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] PATH_INFO: `/v3/users/92a17e87cd544c4aa7123bc81c6e5749` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:55.211102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a17e87cd544c4aa7123bc81c6e5749)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:55.213130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:55.277050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a17e87cd544c4aa7123bc81c6e5749'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.278561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a17e87cd544c4aa7123bc81c6e5749'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.292330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a17e87cd544c4aa7123bc81c6e5749'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.306387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a17e87cd544c4aa7123bc81c6e5749'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.307613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e00d5743-5160-4806-a5c8-2e0c017bc84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a17e87cd544c4aa7123bc81c6e5749'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.338656 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 830/1656] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:40:55 2021] DELETE /identity/v3/users/92a17e87cd544c4aa7123bc81c6e5749 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:55.634219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:55.639077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:55.659436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca9ea1-0c29-44ba-9584-ff8627c8c1a9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:55.748181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:55.749912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:55.750273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:55.750633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] PATH_INFO: `/v3/projects/110fb177004e4ecdac08264077fb091c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:55.752936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=110fb177004e4ecdac08264077fb091c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:55.755886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:55.824079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110fb177004e4ecdac08264077fb091c', 'request_id': 'req-c224972d-0dc0-4457-a285-d4c4552a3497'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.839169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110fb177004e4ecdac08264077fb091c', 'request_id': 'req-c224972d-0dc0-4457-a285-d4c4552a3497'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.854051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110fb177004e4ecdac08264077fb091c', 'request_id': 'req-c224972d-0dc0-4457-a285-d4c4552a3497'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.889169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] The token cache is being invalidate because project 110fb177004e4ecdac08264077fb091c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:40:55.890156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.892659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c224972d-0dc0-4457-a285-d4c4552a3497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:55.909250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 827/1657] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:40:55 2021] DELETE /identity/v3/projects/110fb177004e4ecdac08264077fb091c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:55.912316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:55.913548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:55.914032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:55.951122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:55.953065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:56.129203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 831/1658] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:56.139561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.140480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.140924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:56.257639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:56.259176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:56.292937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 828/1659] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:56.297791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:56.315349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbef30-1dc5-4fb7-aba7-6b84713d17c4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:56.321721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:56.322651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.323228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.323614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:56.325160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:40:56.325577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:56.327503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:56.350848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 832/1660] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:40:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:40:56.352057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:56.365876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe652-c9ae-401f-a92c-57387ae51e1c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:56.381766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:56.384393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.384674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.385825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:56.385825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:56.398621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:56.478960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 829/1661] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:56 2021] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:56.485020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:56.528022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ce4d-e231-4530-a8cd-94f669df71b3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:56.749889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:56.752278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.752770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.753233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:56.754761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:56.763626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:56.823115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 833/1662] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:56 2021] POST /identity/v3/users => generated 284 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:56.829451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:56.868825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c81f-0a94-41e8-bf1d-4b182babaed9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:56.869185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:56.870226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.870981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.871441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:56.873005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:56.875614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:56.897442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 830/1663] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:56.901474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:56.914508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d813-85d2-4e21-aeac-e69d8b42f64c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:56.932260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276517f2-6b54-4ff1-ae11-1d8779e791c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:56.932959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276517f2-6b54-4ff1-ae11-1d8779e791c0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.933238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276517f2-6b54-4ff1-ae11-1d8779e791c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.933699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276517f2-6b54-4ff1-ae11-1d8779e791c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:56.934580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276517f2-6b54-4ff1-ae11-1d8779e791c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:56.937515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276517f2-6b54-4ff1-ae11-1d8779e791c0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:56.965112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 834/1664] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:40:56.971671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:56.984409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e4d2-68f1-423e-a18b-61906ce15988 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:56.996159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:56.997221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:56.997575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:56.998570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] PATH_INFO: `/v3/projects/022b751b98434724a8c8db0aba74f3ad/users/de0904263cf14f09ba548c9513e562ea/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.047664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022b751b98434724a8c8db0aba74f3ad, user_id=de0904263cf14f09ba548c9513e562ea, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:57.055317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:57.081295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 831/1665] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:56 2021] PUT /identity/v3/projects/022b751b98434724a8c8db0aba74f3ad/users/de0904263cf14f09ba548c9513e562ea/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:57.093077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:57.093578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:57.093940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.174614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] MFA Rules not processed for user `de0904263cf14f09ba548c9513e562ea`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:57.178879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:57.274257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:57.277952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:57.343299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 835/1666] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:57 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:57.345143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:57.508196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e83dc-ccfe-4240-907d-13f10f28d233 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:57.521617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987239c-3f1c-4e83-a4c7-a093686029fb None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:57.522528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:57.523636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:57.523928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:57.524466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] PATH_INFO: `/v3/users/4fa0a11854d644bab448efc0fbaeecb7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.526486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:57.527415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:57.527786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:57.528189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.528907 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:57.530036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa0a11854d644bab448efc0fbaeecb7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:57.531034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:57.532053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:57.572064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 836/1667] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:40:57 2021] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:57.585292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:57.609769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa0a11854d644bab448efc0fbaeecb7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:57.619800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa0a11854d644bab448efc0fbaeecb7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:57.620438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa0a11854d644bab448efc0fbaeecb7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:57.650273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa0a11854d644bab448efc0fbaeecb7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:57.662417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-eebb78b4-8381-4e48-9d76-514d8b84e332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa0a11854d644bab448efc0fbaeecb7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:57.679014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 832/1668] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:40:57 2021] DELETE /identity/v3/users/4fa0a11854d644bab448efc0fbaeecb7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:57.682545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:57.682991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:57.683419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.716139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:57.717624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:57.731460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf8aab-05b0-4889-bc8a-f5b993a76332 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:57.858280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:57.859102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:57.859461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:57.859810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.860593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:57.862706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:57.882508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 833/1669] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:57.894853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:57.897483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:57.905247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 837/1670] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:40:57 2021] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:40:57.910189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:57.915482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:57.937891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486dd02-5ec4-4bec-afd0-823a4a82ef44 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:57.954789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:57.956372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:57.957131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:57.957805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:57.960295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:57.963134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:57.997526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 838/1671] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:57 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:58.003803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:58.015582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf86e-1d45-4ed1-9a77-c36e1ca5a533 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:58.016196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee88c0-0591-487d-9743-5c5915fccf78 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:58.020124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:58.021100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.021731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.022175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:58.022312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.023609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.024063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.024555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] PATH_INFO: `/v3/projects/9da84ece2a474b3d9dc9acd6d16d3d37/users/1a06171dab2748b696af24c10f744eae/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.046119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da84ece2a474b3d9dc9acd6d16d3d37, user_id=1a06171dab2748b696af24c10f744eae, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:58.049609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:58.053129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:58.056641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:58.072180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 839/1672] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:58 2021] PUT /identity/v3/projects/9da84ece2a474b3d9dc9acd6d16d3d37/users/1a06171dab2748b696af24c10f744eae/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:40:58.077319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:58.081859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 834/1673] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:58.221088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a29-efb2-41ea-9ca4-07fde9b9a1ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:58.252724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095b0cc-0a8a-4bcf-9f20-73f2cfc55295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:58.253670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095b0cc-0a8a-4bcf-9f20-73f2cfc55295 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.253968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095b0cc-0a8a-4bcf-9f20-73f2cfc55295 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.254247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095b0cc-0a8a-4bcf-9f20-73f2cfc55295 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.255183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095b0cc-0a8a-4bcf-9f20-73f2cfc55295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:58.256810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095b0cc-0a8a-4bcf-9f20-73f2cfc55295 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:58.282062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 840/1674] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:40:58.288098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:58.310376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb495d-b1bb-43e2-8e9c-3f179af8144e service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:58.336942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:58.340381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.341822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.342180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] PATH_INFO: `/v3/projects/9da84ece2a474b3d9dc9acd6d16d3d37/users/1a06171dab2748b696af24c10f744eae/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.349081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da84ece2a474b3d9dc9acd6d16d3d37, user_id=1a06171dab2748b696af24c10f744eae, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:58.355784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:58.383516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 835/1675] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:40:58 2021] PUT /identity/v3/projects/9da84ece2a474b3d9dc9acd6d16d3d37/users/1a06171dab2748b696af24c10f744eae/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:40:58.395983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.397206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.397851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.480851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] MFA Rules not processed for user `1a06171dab2748b696af24c10f744eae`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:40:58.482127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:58.588283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:58.591501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:58.663782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 841/1676] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:58 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:40:58.673690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:58.675134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:58.763309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ca90a-dce9-460f-8a35-75d25ab27630 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:58.763537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1f143-0e78-4e9d-879e-25ee53595dfa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:58.767678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:58.768587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:58.768871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.769310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.769551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:58.769730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:58.770011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] PATH_INFO: `/v3/projects/ffc9e3e18ab1455e98c26d93e2361b9a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.771332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:58.772130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc9e3e18ab1455e98c26d93e2361b9a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:58.774167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:58.782558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:58.785338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:58.796533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 842/1677] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:40:58 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:40:58.890551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc9e3e18ab1455e98c26d93e2361b9a', 'request_id': 'req-fef45415-923c-4810-b8eb-04f45d02743c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:58.896904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc9e3e18ab1455e98c26d93e2361b9a', 'request_id': 'req-fef45415-923c-4810-b8eb-04f45d02743c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:58.906171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc9e3e18ab1455e98c26d93e2361b9a', 'request_id': 'req-fef45415-923c-4810-b8eb-04f45d02743c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:58.922226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] The token cache is being invalidate because project ffc9e3e18ab1455e98c26d93e2361b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:40:58.922839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:58.934009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:58.937163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 836/1678] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:40:58 2021] DELETE /identity/v3/projects/ffc9e3e18ab1455e98c26d93e2361b9a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:58.941106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:58.951679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03f47-7787-4139-b3e7-55cdf0daf169 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:59.040593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:59.041471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:59.041749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:59.042020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] PATH_INFO: `/v3/users/78aabd6434f34e7fb4e6ab797f808777` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:59.043214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78aabd6434f34e7fb4e6ab797f808777)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:59.045138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:59.104964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78aabd6434f34e7fb4e6ab797f808777'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.105631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78aabd6434f34e7fb4e6ab797f808777'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.114451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78aabd6434f34e7fb4e6ab797f808777'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.131553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78aabd6434f34e7fb4e6ab797f808777'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.132517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6b0788ab-b2d0-4511-867d-4db8eaefdc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78aabd6434f34e7fb4e6ab797f808777'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.166635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 843/1679] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:40:58 2021] DELETE /identity/v3/users/78aabd6434f34e7fb4e6ab797f808777 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:59.683723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:40:59.685342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:40:59.700382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45415-923c-4810-b8eb-04f45d02743c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:40:59.825836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:40:59.827861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:59.828304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:59.828915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] PATH_INFO: `/v3/projects/8fa3fbb8aff14299b4605ab0c6914d65` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:40:59.836293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa3fbb8aff14299b4605ab0c6914d65)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:40:59.838265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:40:59.919380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa3fbb8aff14299b4605ab0c6914d65', 'request_id': 'req-120710d1-366e-420c-a2fe-98d6b5461a0e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.921735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa3fbb8aff14299b4605ab0c6914d65', 'request_id': 'req-120710d1-366e-420c-a2fe-98d6b5461a0e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.939438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa3fbb8aff14299b4605ab0c6914d65', 'request_id': 'req-120710d1-366e-420c-a2fe-98d6b5461a0e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.960540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] The token cache is being invalidate because project 8fa3fbb8aff14299b4605ab0c6914d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:40:59.960915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.961684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-120710d1-366e-420c-a2fe-98d6b5461a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:40:59.966959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 837/1680] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:40:59 2021] DELETE /identity/v3/projects/8fa3fbb8aff14299b4605ab0c6914d65 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:40:59.972321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:40:59.974238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:40:59.974755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.003822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:00.006400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:00.094630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 844/1681] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:40:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:00.104608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.105444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.105919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.139911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:00.141084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:00.150164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 838/1682] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:00.156338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.171485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6625-fab6-44c3-960f-06f385718bbc None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.177617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.178337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.178625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.178905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.179687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:00.179999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.181671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.200424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.205804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 845/1683] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:00.210151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb4e65-b169-43c2-a5c7-9770e1a3a3e0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.214812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.215846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.216133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.216410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.217099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.219190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.263024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 839/1684] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:00 2021] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:00.270202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.303989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a121c2-a864-4e5a-92a6-70ae01cd2b0a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.401256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.401931 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.402213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.402493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.403217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.405145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.426302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 846/1685] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:00 2021] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:00.432489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.444447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06a029-aafa-4d7d-8fef-8b84758a99ea admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.452370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.452955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.453389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.453807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.454690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.456238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.471741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 840/1686] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:00 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:00.472783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.483168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d34842-f003-4c17-934b-9a5ba4192cc4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.488111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222f35-d421-45be-85f8-855d3c764cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.488824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222f35-d421-45be-85f8-855d3c764cbc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.489700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222f35-d421-45be-85f8-855d3c764cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.490036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222f35-d421-45be-85f8-855d3c764cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.490774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2222f35-d421-45be-85f8-855d3c764cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.492466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2222f35-d421-45be-85f8-855d3c764cbc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.506442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 847/1687] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:00.514139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.526438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273f13-ca31-4742-87f6-ab58e3c828c2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.531256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.532230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.532519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.536012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] PATH_INFO: `/v3/projects/3fa4ad1812f24e7d9651500ec6555614/users/16a8531c43fe4c3cab2d574e14e2f013/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.572945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa4ad1812f24e7d9651500ec6555614, user_id=16a8531c43fe4c3cab2d574e14e2f013, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.576288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.594444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 841/1688] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:00 2021] PUT /identity/v3/projects/3fa4ad1812f24e7d9651500ec6555614/users/16a8531c43fe4c3cab2d574e14e2f013/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:00.606368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.606951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.607261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.647771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] MFA Rules not processed for user `16a8531c43fe4c3cab2d574e14e2f013`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:00.649166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:00.717140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.719514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:00.808520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 848/1689] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:00 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:00.814148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.826159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef757d2-c3df-407f-b8df-80c3a85510aa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.827307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1708e-27b1-4379-a203-e6ae93a01b14 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:00.831426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.832333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:00.832816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.833836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.833947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:00.834238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:00.834340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] PATH_INFO: `/v3/users/de0904263cf14f09ba548c9513e562ea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.834646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:00.835448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.836235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0904263cf14f09ba548c9513e562ea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:00.837808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.840532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:00.888650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 849/1690] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:00 2021] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:00.894090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:00.926051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0904263cf14f09ba548c9513e562ea'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:00.935193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0904263cf14f09ba548c9513e562ea'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:00.945648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0904263cf14f09ba548c9513e562ea'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:00.968076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0904263cf14f09ba548c9513e562ea'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:00.991983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7b521ac8-252f-4274-9cbc-454cd62a3149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0904263cf14f09ba548c9513e562ea'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:01.002006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 842/1691] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:00 2021] DELETE /identity/v3/users/de0904263cf14f09ba548c9513e562ea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:01.009360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.009670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.009951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.015248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a5f9-a7df-40fa-b022-7678d85ad32a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.041408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:01.042859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.078676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.079408 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.079752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.079973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.080755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.082734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.108528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 843/1692] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:01.122974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.126989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 850/1693] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:00 2021] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:01.130976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.131425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.139865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.152668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a82ab-c797-4c79-aad6-16f648d51224 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.157665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.158617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.159143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.159607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.160456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.163227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.175301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 851/1694] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:01.180784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.200903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d254cf-b821-49fc-8386-6b2410eb5b19 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.205967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.206991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.207286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.207566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] PATH_INFO: `/v3/projects/1d7e8254e6e4475b8555b5245a66fc1d/users/0fc0051463c542feaa47962e43bb7867/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.226217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7e8254e6e4475b8555b5245a66fc1d, user_id=0fc0051463c542feaa47962e43bb7867, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.229116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.237717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac1458-e43f-47d1-80fa-75d03a957400 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.242060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.242724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.243026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.243414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.248228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 852/1695] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:01 2021] PUT /identity/v3/projects/1d7e8254e6e4475b8555b5245a66fc1d/users/0fc0051463c542feaa47962e43bb7867/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:01.252105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.258990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.260499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.273131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 844/1696] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:01.349955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65f6d-9631-434d-bf8c-9959d17b7de8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.358436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acdfa-20f6-4b46-b0b9-270a5d93957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.359321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acdfa-20f6-4b46-b0b9-270a5d93957d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.359703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acdfa-20f6-4b46-b0b9-270a5d93957d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.360498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acdfa-20f6-4b46-b0b9-270a5d93957d admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.360905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acdfa-20f6-4b46-b0b9-270a5d93957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.363347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acdfa-20f6-4b46-b0b9-270a5d93957d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.377295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 853/1697] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:01.383603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.403245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ccdf-69e6-40ad-9d45-b8d5df8cd5f4 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.429535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.430469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.430755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.431092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] PATH_INFO: `/v3/projects/1d7e8254e6e4475b8555b5245a66fc1d/users/0fc0051463c542feaa47962e43bb7867/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.433111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7e8254e6e4475b8555b5245a66fc1d, user_id=0fc0051463c542feaa47962e43bb7867, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.436599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.459878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 845/1698] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:01 2021] PUT /identity/v3/projects/1d7e8254e6e4475b8555b5245a66fc1d/users/0fc0051463c542feaa47962e43bb7867/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:01.464215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c85415-0786-4d28-845e-98cd327f363c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.464578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c85415-0786-4d28-845e-98cd327f363c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.464773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c85415-0786-4d28-845e-98cd327f363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.506864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-65c85415-0786-4d28-845e-98cd327f363c None None] MFA Rules not processed for user `0fc0051463c542feaa47962e43bb7867`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:01.508372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-65c85415-0786-4d28-845e-98cd327f363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.609145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 854/1699] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:01 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:01.621764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.623828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.703430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5dde9-4da2-4f7f-88e8-1bc20d6a8ee5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.707384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.708742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.709035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.709515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.720055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.721611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.730025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c85415-0786-4d28-845e-98cd327f363c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.731774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-65c85415-0786-4d28-845e-98cd327f363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.733492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 846/1700] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:01 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:01.809128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:01.810483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.822430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86177895-51f5-46ec-8ccc-bd05907d758c service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.826114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.827045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.828050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.828050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.829453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:01.839107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c85415-0786-4d28-845e-98cd327f363c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:01.843982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:01.844922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:01.845217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:01.845491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] PATH_INFO: `/v3/projects/022b751b98434724a8c8db0aba74f3ad` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:01.846712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022b751b98434724a8c8db0aba74f3ad)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.863657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.951169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:01.951169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:01.969292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 847/1701] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:01 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:01.983627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022b751b98434724a8c8db0aba74f3ad', 'request_id': 'req-666ce70a-b004-4326-a263-135d39c29024'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:01.991715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022b751b98434724a8c8db0aba74f3ad', 'request_id': 'req-666ce70a-b004-4326-a263-135d39c29024'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.002553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022b751b98434724a8c8db0aba74f3ad', 'request_id': 'req-666ce70a-b004-4326-a263-135d39c29024'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.017051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] The token cache is being invalidate because project 022b751b98434724a8c8db0aba74f3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:02.018008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.018008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.019619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 855/1702] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:01 2021] DELETE /identity/v3/projects/022b751b98434724a8c8db0aba74f3ad => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:02.025436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:02.045158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cc171-0827-4719-bfa3-71298f5440df service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:02.144373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:02.146471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:02.147071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:02.147460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] PATH_INFO: `/v3/users/1a06171dab2748b696af24c10f744eae` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:02.149494 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a06171dab2748b696af24c10f744eae)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:02.153905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:02.300105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a06171dab2748b696af24c10f744eae'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.325712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a06171dab2748b696af24c10f744eae'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.334992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a06171dab2748b696af24c10f744eae'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.370142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a06171dab2748b696af24c10f744eae'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.383114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2daa4d65-9658-44dc-8f8e-c62065c99b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a06171dab2748b696af24c10f744eae'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:02.390949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 848/1703] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:02 2021] DELETE /identity/v3/users/1a06171dab2748b696af24c10f744eae => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:02.907554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:02.910782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:02.941872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce70a-b004-4326-a263-135d39c29024 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.043559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.044544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.044909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.045212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] PATH_INFO: `/v3/projects/9da84ece2a474b3d9dc9acd6d16d3d37` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.047032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da84ece2a474b3d9dc9acd6d16d3d37)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.049727 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.127531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da84ece2a474b3d9dc9acd6d16d3d37', 'request_id': 'req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:03.136093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da84ece2a474b3d9dc9acd6d16d3d37', 'request_id': 'req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:03.146599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da84ece2a474b3d9dc9acd6d16d3d37', 'request_id': 'req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:03.170770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] The token cache is being invalidate because project 9da84ece2a474b3d9dc9acd6d16d3d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:03.171366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:03.172295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-9e1bb96e-31ec-409f-99e8-cf2649fbb0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:03.174570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 856/1704] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:02 2021] DELETE /identity/v3/projects/9da84ece2a474b3d9dc9acd6d16d3d37 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:03.181633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.182585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.182867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.203861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:03.205053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:03.297439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 849/1705] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:03.305799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.306084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.306540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.326234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:03.327505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:03.350685 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 857/1706] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:03.354901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:03.365144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7581bc6-d1b2-43f0-9840-66f1258fb912 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.379146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.380233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.380643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.381094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.382016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:03.382334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.384651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.405624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 850/1707] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:03.407685 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:03.424850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dd8c2-1589-4400-a2f8-ebb36c12685a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.437493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.439906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.440602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.441300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.442957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.447710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.519626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 858/1708] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:03 2021] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:03.524582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:03.541272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f6a3-3dc3-477f-a3f2-2586c81459df admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.689715 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.690811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.691290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.691720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.693786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.696114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.751998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 851/1709] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:03 2021] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:03.755515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:03.767815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d47a9-863d-4116-b6ab-37ee74945e06 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.784994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.785743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.786934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.787230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.789644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.793568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.822606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:03.823705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 859/1710] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:03 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:03.838470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1692-7d04-453a-867f-8a79dfb48370 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.849404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a402e1-434c-40a8-97b5-7c2b6603fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.850110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a402e1-434c-40a8-97b5-7c2b6603fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.850472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a402e1-434c-40a8-97b5-7c2b6603fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.850794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a402e1-434c-40a8-97b5-7c2b6603fb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.851711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a402e1-434c-40a8-97b5-7c2b6603fb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.853611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a402e1-434c-40a8-97b5-7c2b6603fb3f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.899215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 852/1711] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:03 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:03.900235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:03.911665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35dc68-8866-45ac-b144-0d8775103c30 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:03.925032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:03.925968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:03.926240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:03.927134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] PATH_INFO: `/v3/projects/85e3b1872b224c24af99bcb18ab63254/users/e4d013a3635c462f8db1c4c2b1b1ad04/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:03.964114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e3b1872b224c24af99bcb18ab63254, user_id=e4d013a3635c462f8db1c4c2b1b1ad04, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:03.966827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:03.991771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 860/1712] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:03 2021] PUT /identity/v3/projects/85e3b1872b224c24af99bcb18ab63254/users/e4d013a3635c462f8db1c4c2b1b1ad04/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:04.012595 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.013582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.013876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.071580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] MFA Rules not processed for user `e4d013a3635c462f8db1c4c2b1b1ad04`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:04.074553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:04.215338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 853/1713] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:04 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:04.217776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.316976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926fbc7-d8e3-4665-94ca-eb48ede1e9ff admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:04.322623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:04.323320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.323597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.323874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.324580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:04.326502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:04.373273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 861/1714] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:04 2021] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:04.377662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.389937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ff005-adee-4b2d-9286-34e2c738a0dc None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:04.468162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:04.468818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.469037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.469294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.469990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:04.472008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:04.494986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 854/1715] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:04 2021] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:04.500527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.513054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec67632-6759-45ea-ba31-878ede3ee6d5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:04.517531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:04.518194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.518505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.518776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.519525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:04.521271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:04.532148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 862/1716] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:04.536908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.546594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4322-f14a-481c-9154-8f7b0ea780ad admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:04.551119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:04.552641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.552929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.553206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] PATH_INFO: `/v3/projects/41b8760eca0b44c794cdb3bca355978d/users/59a87f9b6acb403ea923a4b16e732a20/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.570534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b8760eca0b44c794cdb3bca355978d, user_id=59a87f9b6acb403ea923a4b16e732a20, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:04.573449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:04.590576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 855/1717] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:04 2021] PUT /identity/v3/projects/41b8760eca0b44c794cdb3bca355978d/users/59a87f9b6acb403ea923a4b16e732a20/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:04.594381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.604512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ba74-3d81-40b5-a45f-5451e6810f9f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:04.662870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fc9db-5646-49bb-b03f-f633c2d964cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:04.663608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fc9db-5646-49bb-b03f-f633c2d964cb admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.663897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fc9db-5646-49bb-b03f-f633c2d964cb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.664291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fc9db-5646-49bb-b03f-f633c2d964cb admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.665132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fc9db-5646-49bb-b03f-f633c2d964cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:04.667068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fc9db-5646-49bb-b03f-f633c2d964cb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:04.677896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 863/1718] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:04 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:04.682309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.693412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6b146-271c-4891-bbab-43a014634ffa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:04.697980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:04.698861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.699179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.699445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] PATH_INFO: `/v3/projects/41b8760eca0b44c794cdb3bca355978d/users/59a87f9b6acb403ea923a4b16e732a20/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.701386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b8760eca0b44c794cdb3bca355978d, user_id=59a87f9b6acb403ea923a4b16e732a20, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:04.704028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:04.715557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 856/1719] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:04 2021] PUT /identity/v3/projects/41b8760eca0b44c794cdb3bca355978d/users/59a87f9b6acb403ea923a4b16e732a20/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:04.727124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:04.727372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:04.727568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:04.772306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] MFA Rules not processed for user `59a87f9b6acb403ea923a4b16e732a20`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:04.773658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:04.868968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 864/1720] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:04 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:04.884084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:04.888363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:05.018862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21a246-4ebe-4181-88b7-b25085097372 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:05.023169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:05.023799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:05.024083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:05.024359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:05.033993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:05.035495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:05.045857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 857/1721] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:04 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:05.515038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:05.525269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec0f5-c77b-4683-a035-0e4fa3d89229 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:05.529707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a87f9b6acb403ea923a4b16e732a20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b8760eca0b44c794cdb3bca355978d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:05.530431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:05.530726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:05.531041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:05.531810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:05.532117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:05.533995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:05.548457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 865/1722] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:05.553586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:05.563701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb8b-dc16-4ade-ae53-0542d37db9a9 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:05.567782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a87f9b6acb403ea923a4b16e732a20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b8760eca0b44c794cdb3bca355978d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:05.568533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:05.568832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:05.569113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:05.569814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:05.571876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:05.600734 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 858/1723] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:05 2021] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:05.605572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:05.616039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a8bdb-9ed7-400b-8f3b-f4e4d13683cb tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:05.697299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a87f9b6acb403ea923a4b16e732a20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b8760eca0b44c794cdb3bca355978d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:05.700312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:05.700614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:05.700901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:05.701736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:05.702057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:05.703976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:05.721425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 866/1724] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:05.761267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:05.772105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021701-c138-4408-94a9-c246100e04ca tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:05.776554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59a87f9b6acb403ea923a4b16e732a20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b8760eca0b44c794cdb3bca355978d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:05.777521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:05.777812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:05.778099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] PATH_INFO: `/v3/projects/fa786e88296b460eae28b488081770c0` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:05.779307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa786e88296b460eae28b488081770c0)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:05.781225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:05.854562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa786e88296b460eae28b488081770c0', 'request_id': 'req-c6a58f2a-97c9-4bfc-bd52-56db9c737771'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:05.862698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa786e88296b460eae28b488081770c0', 'request_id': 'req-c6a58f2a-97c9-4bfc-bd52-56db9c737771'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:05.876039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa786e88296b460eae28b488081770c0', 'request_id': 'req-c6a58f2a-97c9-4bfc-bd52-56db9c737771'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:05.894023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] The token cache is being invalidate because project fa786e88296b460eae28b488081770c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:05.894422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:05.896156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:05.898806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 859/1725] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:05 2021] DELETE /identity/v3/projects/fa786e88296b460eae28b488081770c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:05.958462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:05.960669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:06.103159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a2aa-c9fc-4a7f-8bdd-a43535e05f86 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:06.225987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:06.228384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:06.282478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:06.283465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:06.283896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:06.284180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] PATH_INFO: `/v3/users/16a8531c43fe4c3cab2d574e14e2f013` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:06.285465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a8531c43fe4c3cab2d574e14e2f013)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:06.288394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:06.398884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a8531c43fe4c3cab2d574e14e2f013'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.400885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a8531c43fe4c3cab2d574e14e2f013'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.416151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a8531c43fe4c3cab2d574e14e2f013'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.435304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a58f2a-97c9-4bfc-bd52-56db9c737771 tempest-VolumeQuotaClassesTest-1469582379 tempest-VolumeQuotaClassesTest-1469582379-project-admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:06.441227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:06.442819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:06.443253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:06.443603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] PATH_INFO: `/v3/users/e4d013a3635c462f8db1c4c2b1b1ad04` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:06.444929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d013a3635c462f8db1c4c2b1b1ad04)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:06.445437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a8531c43fe4c3cab2d574e14e2f013'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.447158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a462339c-94ac-4f8a-9e6e-b93160d3570d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a8531c43fe4c3cab2d574e14e2f013'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.447582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:06.554621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 867/1726] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:05 2021] DELETE /identity/v3/users/16a8531c43fe4c3cab2d574e14e2f013 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:06.559952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:06.560252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:06.560585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:06.590546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d013a3635c462f8db1c4c2b1b1ad04'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.608302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d013a3635c462f8db1c4c2b1b1ad04'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.609144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d013a3635c462f8db1c4c2b1b1ad04'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.622133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:06.630250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:06.641812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d013a3635c462f8db1c4c2b1b1ad04'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.666735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5596f496-486a-4a37-9a61-8499698caeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d013a3635c462f8db1c4c2b1b1ad04'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:06.687513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 860/1727] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:06 2021] DELETE /identity/v3/users/e4d013a3635c462f8db1c4c2b1b1ad04 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:06.694720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:06.694930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:06.695318 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:06.769108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:06.772290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:06.821282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 868/1728] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:06.834171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:06.836217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:06.852795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 861/1729] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:06.864587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:06.866712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:06.913542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884b2d2-ce36-4a4e-9d80-857c0c7c34a5 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:06.944921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164ed1-d1a0-4837-910d-4dca0ba9666d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:06.948776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:06.949650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:06.949944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:06.950229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:06.990888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:06.994668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:07.008089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:07.009146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:07.009666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:07.010260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:07.018602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 862/1730] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:07.024423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:07.026255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:07.053088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 869/1731] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:07.482901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:07.486051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:07.506541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02c99-547b-49e7-a3be-5b4db8e7858c service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:07.511643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:07.512779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:07.513156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:07.513525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] PATH_INFO: `/v3/projects/3fa4ad1812f24e7d9651500ec6555614` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:07.515008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa4ad1812f24e7d9651500ec6555614)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:07.517409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:07.583288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa4ad1812f24e7d9651500ec6555614', 'request_id': 'req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:07.589916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa4ad1812f24e7d9651500ec6555614', 'request_id': 'req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:07.599201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa4ad1812f24e7d9651500ec6555614', 'request_id': 'req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:07.611220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] The token cache is being invalidate because project 3fa4ad1812f24e7d9651500ec6555614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:07.611498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:07.612160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-85215d8c-b2b0-4ad8-8563-c9a8e5b5e923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:07.613745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 863/1732] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:07 2021] DELETE /identity/v3/projects/3fa4ad1812f24e7d9651500ec6555614 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:07.618075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:07.629096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dedfc-4ee1-4893-a583-5a8fca109bb7 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:07.696140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:07.696772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:07.697548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:07.743071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:07.744270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:07.845371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:07.848543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:07.849382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:07.849837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] PATH_INFO: `/v3/users/0fc0051463c542feaa47962e43bb7867` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:07.852597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc0051463c542feaa47962e43bb7867)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:07.858363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:07.907383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 864/1733] 10.222.0.70 () {58 vars in 1016 bytes} [Tue Jul 13 08:41:07 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:07.982947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:07.985563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:08.001848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390330d7-8de9-46f3-93f2-b4ab03f403cd None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:08.024811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:08.029554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:08.029853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:08.030131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:08.036619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc0051463c542feaa47962e43bb7867'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:08.051633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc0051463c542feaa47962e43bb7867'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:08.067469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc0051463c542feaa47962e43bb7867'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:08.081551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:08.083067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc0051463c542feaa47962e43bb7867'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:08.083350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:08.084722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc0051463c542feaa47962e43bb7867'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:08.122650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 865/1734] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:08.125278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:08.129134 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:08.135497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 870/1735] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:07 2021] DELETE /identity/v3/users/0fc0051463c542feaa47962e43bb7867 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:08.150530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957b4c9-cf41-4af5-bfef-9481ce09abd8 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:08.219451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:08.220674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:08.221136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:08.221823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:08.225422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:08.236658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:08.238585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:08.248886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 866/1736] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:08 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:09.100738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:09.102898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:09.271911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063af9-1984-48f8-80ac-8638cd619a71 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:09.277899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:09.279287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:09.279784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:09.280159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] PATH_INFO: `/v3/projects/85e3b1872b224c24af99bcb18ab63254` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:09.281680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e3b1872b224c24af99bcb18ab63254)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:09.283902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:09.347757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e3b1872b224c24af99bcb18ab63254', 'request_id': 'req-802c3c6a-fd95-4561-8b80-976faf388024'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.356256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e3b1872b224c24af99bcb18ab63254', 'request_id': 'req-802c3c6a-fd95-4561-8b80-976faf388024'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.367346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e3b1872b224c24af99bcb18ab63254', 'request_id': 'req-802c3c6a-fd95-4561-8b80-976faf388024'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.383781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] The token cache is being invalidate because project 85e3b1872b224c24af99bcb18ab63254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:09.384410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.385493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-802c3c6a-fd95-4561-8b80-976faf388024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.387770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 871/1737] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:09 2021] DELETE /identity/v3/projects/85e3b1872b224c24af99bcb18ab63254 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:09.393462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:09.414316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50f526-9477-4e2d-b6ca-76802a56373a service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:09.440125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d996e-3ef6-4528-bfbe-98f5ddc15985 None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:09.440319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d996e-3ef6-4528-bfbe-98f5ddc15985 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:09.440603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d996e-3ef6-4528-bfbe-98f5ddc15985 None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:09.443151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 872/1738] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:41:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:41:09.453369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:09.453670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:09.453931 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:09.497472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:09.499246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:09.536868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:09.537826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:09.538158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:09.538441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] PATH_INFO: `/v3/users/59a87f9b6acb403ea923a4b16e732a20` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:09.544279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a87f9b6acb403ea923a4b16e732a20)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:09.544279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:09.633659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a87f9b6acb403ea923a4b16e732a20'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.647177 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a87f9b6acb403ea923a4b16e732a20'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.649099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a87f9b6acb403ea923a4b16e732a20'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.662986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 873/1739] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:41:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:09.665216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:09.667521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:09.669297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a87f9b6acb403ea923a4b16e732a20'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.684331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a87f9b6acb403ea923a4b16e732a20'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:09.699158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 867/1740] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:09 2021] DELETE /identity/v3/users/59a87f9b6acb403ea923a4b16e732a20 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:09.702302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b674958-d3e0-43f3-b7fa-787f74fc7ae9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:09.727181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:09.730337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:09.885527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:09.887472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:09.888285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:09.888801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] PATH_INFO: `/v3/projects/1d7e8254e6e4475b8555b5245a66fc1d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:09.901233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7e8254e6e4475b8555b5245a66fc1d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:09.904250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.034411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51081911-c236-4c66-882b-271e7b05c5c2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.046066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7e8254e6e4475b8555b5245a66fc1d', 'request_id': 'req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.058059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7e8254e6e4475b8555b5245a66fc1d', 'request_id': 'req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.069797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7e8254e6e4475b8555b5245a66fc1d', 'request_id': 'req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.087997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] The token cache is being invalidate because project 1d7e8254e6e4475b8555b5245a66fc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:10.088662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.090037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca3c0f88-9f39-40eb-b54b-f5b3bba60fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.092253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 874/1741] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:09 2021] DELETE /identity/v3/projects/1d7e8254e6e4475b8555b5245a66fc1d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:10.107199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.109481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.110465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.149495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:10.151758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.153960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.155240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.155765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.156243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.159131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.174669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.176937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e983e-5cfe-48a6-8aca-a8260536c960 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.195001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 868/1742] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:10.261741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 875/1743] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:10.266251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.266837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.267142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.312735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:10.314943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.347963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 869/1744] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:10.349698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.361773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed6901-86de-4f69-a034-0dc025f2f66c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.375367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.376200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.376527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.376799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.377698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:10.378012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.380779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.412200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 876/1745] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:41:10.413771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.424036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f5f9-683f-45eb-a0e7-6bcdaf98a4dd None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.431642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.434281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.439722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.441615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.444058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.444971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.446851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.449456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.475046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b9280-3cb5-408c-91ef-39644da7b8c4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.482337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.483239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.483540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.483976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] PATH_INFO: `/v3/projects/41b8760eca0b44c794cdb3bca355978d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.485683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b8760eca0b44c794cdb3bca355978d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.488545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.508560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 870/1746] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:10.517195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.607154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d661e8-d12a-4513-9f4f-57ee23b7b355 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.630734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b8760eca0b44c794cdb3bca355978d', 'request_id': 'req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.637487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b8760eca0b44c794cdb3bca355978d', 'request_id': 'req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.647511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b8760eca0b44c794cdb3bca355978d', 'request_id': 'req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.661878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] The token cache is being invalidate because project 41b8760eca0b44c794cdb3bca355978d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:10.662189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.662894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e6bf6608-ca1c-4d26-a3cc-763e80949ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:10.664500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 877/1747] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:10 2021] DELETE /identity/v3/projects/41b8760eca0b44c794cdb3bca355978d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:10.670358 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c892-91dd-42b4-bc6e-f3bdb598bee8 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.670637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c892-91dd-42b4-bc6e-f3bdb598bee8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.670930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c892-91dd-42b4-bc6e-f3bdb598bee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.694649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e3f6c892-91dd-42b4-bc6e-f3bdb598bee8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:10.695915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e3f6c892-91dd-42b4-bc6e-f3bdb598bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.696395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.697299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.697607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.697949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.698774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.700777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.711634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 878/1748] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:10.714654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.715041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.715506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.732945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 871/1749] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:10.738975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.740822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.762823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774f861-07ff-4ec8-bdb7-55f06071e6ee admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.770346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.771765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.772244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.772750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.773583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.775511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:10.776026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.780051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.802464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 872/1750] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:10 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:10.804618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.807156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 879/1751] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:10.812097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.830762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06348-db0e-45e3-aa05-72b0a79c272d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.838027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571c98-4bea-4465-a814-b301c336e2a1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.841246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.842863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.843875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.845156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.847221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:10.848280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.851246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a95548-78c2-43d4-bdff-c2f89ac74962 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.852067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff752b-1d04-4455-9d85-42c49f379ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.852769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff752b-1d04-4455-9d85-42c49f379ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.853050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff752b-1d04-4455-9d85-42c49f379ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.853327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff752b-1d04-4455-9d85-42c49f379ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.854071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff752b-1d04-4455-9d85-42c49f379ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.855740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff752b-1d04-4455-9d85-42c49f379ba0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.886084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 873/1752] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:10 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:10.886084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d31fc-0875-4c8e-bfb3-1b4d6b0ea965 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.886084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d31fc-0875-4c8e-bfb3-1b4d6b0ea965 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.886084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d31fc-0875-4c8e-bfb3-1b4d6b0ea965 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.886084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 874/1753] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:41:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:41:10.890168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 880/1754] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:41:10.891808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d31fc-0875-4c8e-bfb3-1b4d6b0ea965 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:10.897053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652215e-3220-4d98-acfd-65ebb31e7060 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.898492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652215e-3220-4d98-acfd-65ebb31e7060 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.899435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652215e-3220-4d98-acfd-65ebb31e7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.921657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d31fc-0875-4c8e-bfb3-1b4d6b0ea965 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:10.926989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:10.928387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:10.929000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:10.929448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] PATH_INFO: `/v3/projects/8ab7dba692d74928aa7322ff794d42f3/users/c47fda84d35741b19e6a195f192daba3/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:10.938569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7652215e-3220-4d98-acfd-65ebb31e7060 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:10.941415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7652215e-3220-4d98-acfd-65ebb31e7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:10.949901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab7dba692d74928aa7322ff794d42f3, user_id=c47fda84d35741b19e6a195f192daba3, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:10.953106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:10.981279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 875/1755] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:10 2021] PUT /identity/v3/projects/8ab7dba692d74928aa7322ff794d42f3/users/c47fda84d35741b19e6a195f192daba3/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:10.983258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.048513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 881/1756] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:11.056667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.056982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.057404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.092314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a914-a3ef-4b5c-8521-6c78c07fcd2e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.092972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] MFA Rules not processed for user `c47fda84d35741b19e6a195f192daba3`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:11.094270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:11.096931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.097602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.097889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.098753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.099776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.101755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.140141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 876/1757] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:10 2021] POST /identity/v3/projects => generated 407 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:11.140141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.140141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:11.175747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 882/1758] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:11 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:11.177382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.195639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453c6f-010e-4b0f-9563-f01d3b55f451 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.267248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2a7d7-b7fa-4631-a028-eae3753e8d9e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.274940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.275794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.276343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.276703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.285478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.286210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.286726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.287120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.287215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.287790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.289154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.290610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.311575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 877/1759] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:11.314379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.338376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f370-0ba1-424b-96f1-e2eaf088d593 service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.347786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.349232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.349812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.350368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.352130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.355935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.385845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 883/1760] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:11 2021] POST /identity/v3/users => generated 304 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:11.392021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.392555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 878/1761] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:11 2021] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:11.397955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.421543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38363191-8a16-4202-a740-72de576b9108 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.481585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9b50-b753-4810-b4ad-8173ff006410 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.488235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.490016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.491012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.491012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.492015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.496249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.531069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 879/1762] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:11 2021] POST /identity/v3/users => generated 306 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:11.536603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.551959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.553238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.553884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.554483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27682c8-04c4-4875-b25b-1025a9e1ed82 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.554737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.555840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.558268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.561333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.562235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.562627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.563349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.564335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.567891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.588834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 880/1763] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:11.590542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.605234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7471-757f-49b1-8809-e730270f7a19 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.606098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 884/1764] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:11.611633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.617218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.618847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.619998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.620395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] PATH_INFO: `/v3/projects/07541bdc95a4449da489fac98595d869/users/5d698680897a449b949216bffa2b5eab/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.632307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ed569-a399-49fb-bf2f-2fc01078022b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.646956 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07541bdc95a4449da489fac98595d869, user_id=5d698680897a449b949216bffa2b5eab, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.652710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.664025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.665654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.666446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.667318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.668989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.678366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.679419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 881/1765] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:11 2021] PUT /identity/v3/projects/07541bdc95a4449da489fac98595d869/users/5d698680897a449b949216bffa2b5eab/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:11.685609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.712619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 885/1766] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:11.717127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.737423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd40b2c-97f0-48b1-a768-83ed5055a0e4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.781844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af838d2f-e733-4e1f-9471-6f2500265746 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.786835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.787762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.788094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.788496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.789127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.790886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.809396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 882/1767] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:11.811786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:11.823478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eb810-5359-43f7-a133-0d3512c68f66 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:11.828844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52089a-899d-45b6-a909-b6647aff9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.830614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52089a-899d-45b6-a909-b6647aff9dda admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.830955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52089a-899d-45b6-a909-b6647aff9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.831250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52089a-899d-45b6-a909-b6647aff9dda admin admin] PATH_INFO: `/v3/projects/07541bdc95a4449da489fac98595d869/users/5d698680897a449b949216bffa2b5eab/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.834374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52089a-899d-45b6-a909-b6647aff9dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=07541bdc95a4449da489fac98595d869, user_id=5d698680897a449b949216bffa2b5eab, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.839013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52089a-899d-45b6-a909-b6647aff9dda admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.865484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d388a-1be0-42b4-a5a5-1f0d280c315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:11.875317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 883/1768] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:11 2021] PUT /identity/v3/projects/07541bdc95a4449da489fac98595d869/users/5d698680897a449b949216bffa2b5eab/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:11.882330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d388a-1be0-42b4-a5a5-1f0d280c315f admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.883471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d388a-1be0-42b4-a5a5-1f0d280c315f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.884213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d388a-1be0-42b4-a5a5-1f0d280c315f admin admin] PATH_INFO: `/v3/projects/c6702d3228b8448a8a35cd08e4eb9f05/users/23f5663ac62347dd8b1399e2b81a46a1/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.887449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.887803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.888190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:11.922026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d388a-1be0-42b4-a5a5-1f0d280c315f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6702d3228b8448a8a35cd08e4eb9f05, user_id=23f5663ac62347dd8b1399e2b81a46a1, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:11.929779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d388a-1be0-42b4-a5a5-1f0d280c315f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:11.952773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] MFA Rules not processed for user `5d698680897a449b949216bffa2b5eab`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:11.955755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:11.961996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 886/1769] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:11 2021] PUT /identity/v3/projects/c6702d3228b8448a8a35cd08e4eb9f05/users/23f5663ac62347dd8b1399e2b81a46a1/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:11.975488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:11.976965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:11.978349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.053483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] MFA Rules not processed for user `23f5663ac62347dd8b1399e2b81a46a1`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:12.054713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:12.146934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 884/1770] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:11 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:12.163095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.165760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:12.213648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 887/1771] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:11 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:12.218038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.318491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581a32-231f-4133-93b6-8fd2a5d66b38 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.322764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.323520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.323988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.324599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.340732 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.343827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.372192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15d4d4-1c90-4694-8962-a1e2f8197bf2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.376950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 885/1772] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:12 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:12.380148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.388501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.388501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.388501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.388501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.388501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.508985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.523285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 888/1773] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:12 2021] POST /identity/v3/projects => generated 409 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:12.525252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb31a-3806-4da6-aec7-cbc2d588409a service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.532432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.534619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:12.626415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.627192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.627427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.627759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.629924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.632041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.669972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 886/1774] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:12 2021] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:12.674578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.688821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207829-2210-40c6-875d-71bfc11610f7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.698702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.705755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.705755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.705755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.705755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.705755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.714144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc29d-4979-4e75-ad58-aada8421d8e7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.719953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 887/1775] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:12 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:12.720482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.731728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a361b-f8a3-443d-8aa0-1876226e7e93 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.737909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.742488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.742852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.743175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] PATH_INFO: `/v3/projects/1af31a5f9eb1484c8489ee3ab6c39ca6/users/ba7fc6fc233847c3afec319da293e9dc/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.748815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.749855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.753664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.754080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.769852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af31a5f9eb1484c8489ee3ab6c39ca6, user_id=ba7fc6fc233847c3afec319da293e9dc, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.775288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.806164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 888/1776] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:12 2021] PUT /identity/v3/projects/1af31a5f9eb1484c8489ee3ab6c39ca6/users/ba7fc6fc233847c3afec319da293e9dc/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:12.811256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:12.883558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.885267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.897625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 889/1777] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:12 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:12.927583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21412b-4e7c-4ec8-a6bb-bfef41777675 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:12.945382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657b32a-cebc-42b9-ba68-9520307746b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:12.946082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657b32a-cebc-42b9-ba68-9520307746b4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:12.947359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657b32a-cebc-42b9-ba68-9520307746b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:12.947508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657b32a-cebc-42b9-ba68-9520307746b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:12.948220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657b32a-cebc-42b9-ba68-9520307746b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:12.949874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657b32a-cebc-42b9-ba68-9520307746b4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:12.990511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 889/1778] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:12 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:12.995050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:13.010234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2228-475f-40a0-ad91-13fd09a4bfd6 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:13.024549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:13.025543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:13.026092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:13.026469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] PATH_INFO: `/v3/projects/1af31a5f9eb1484c8489ee3ab6c39ca6/users/ba7fc6fc233847c3afec319da293e9dc/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:13.031356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af31a5f9eb1484c8489ee3ab6c39ca6, user_id=ba7fc6fc233847c3afec319da293e9dc, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:13.040083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:13.070972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 890/1779] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:12 2021] PUT /identity/v3/projects/1af31a5f9eb1484c8489ee3ab6c39ca6/users/ba7fc6fc233847c3afec319da293e9dc/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:13.080891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:13.081288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:13.081594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:13.142600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] MFA Rules not processed for user `ba7fc6fc233847c3afec319da293e9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:13.144388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:13.347183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 890/1780] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:13 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:13.360327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:13.491452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de498e1-e9b3-4b86-b3b8-1fde39f00bf2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:13.502131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:13.503041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:13.503606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:13.503935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:13.535492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:13.538603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:13.571945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 891/1781] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:13 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:13.928954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:13.938520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3183c1-57b5-4141-a2d8-9ef0188f0860 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:13.943974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cf1dc-fb8e-4131-bd2f-74a02e814371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:13.944886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf1dc-fb8e-4131-bd2f-74a02e814371 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:13.953892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf1dc-fb8e-4131-bd2f-74a02e814371 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:13.954459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf1dc-fb8e-4131-bd2f-74a02e814371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:14.065803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cf1dc-fb8e-4131-bd2f-74a02e814371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:14.069856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cf1dc-fb8e-4131-bd2f-74a02e814371 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:14.085184 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 891/1782] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:13 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:17.175923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:17.194809 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:17.312031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e50bd-3588-45d5-a592-fdf4bfcade85 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:17.321468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:17.323862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:17.323862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:17.324410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] PATH_INFO: `/v3/users/fc7e953bfa8c4f56b8c1bc8492274cea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:17.327269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7e953bfa8c4f56b8c1bc8492274cea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:17.331312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:17.400437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7e953bfa8c4f56b8c1bc8492274cea'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:17.401296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7e953bfa8c4f56b8c1bc8492274cea'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:17.410050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7e953bfa8c4f56b8c1bc8492274cea'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:17.419747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7e953bfa8c4f56b8c1bc8492274cea'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:17.420377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7e953bfa8c4f56b8c1bc8492274cea'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:17.444453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 892/1783] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:17 2021] DELETE /identity/v3/users/fc7e953bfa8c4f56b8c1bc8492274cea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:17.451243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:17.452084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:17.452261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:17.477666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:17.479006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:17.565445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 892/1784] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:17.579004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:17.580574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:17.655771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a22108-7dd9-4f2d-ae61-65eaa46fb573 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:17.659397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:17.660066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:17.660972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:17.661407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:17.671084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:17.672555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:17.682940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 893/1785] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:18.022466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:18.025070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:18.043700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496911ef-f496-4520-9dcc-3e4e7303febd None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:18.050441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:18.052106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:18.052661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:18.053283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] PATH_INFO: `/v3/projects/5087c8d7a83d4851a70414a820ea657b` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:18.055497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5087c8d7a83d4851a70414a820ea657b)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:18.057903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:18.136667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5087c8d7a83d4851a70414a820ea657b', 'request_id': 'req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.146403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5087c8d7a83d4851a70414a820ea657b', 'request_id': 'req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.161521 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5087c8d7a83d4851a70414a820ea657b', 'request_id': 'req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.174903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] The token cache is being invalidate because project 5087c8d7a83d4851a70414a820ea657b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:18.175261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.175968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.178422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 893/1786] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:18 2021] DELETE /identity/v3/projects/5087c8d7a83d4851a70414a820ea657b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:18.183153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:18.198352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7bf8a-4b08-44f9-9aca-3dac91107d94 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:18.284067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:18.285052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:18.286138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:18.286297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] PATH_INFO: `/v3/users/a6b1b83c00cb49b7b43ca629328420ce` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:18.287826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b1b83c00cb49b7b43ca629328420ce)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:18.289963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:18.352925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b1b83c00cb49b7b43ca629328420ce'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.353671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b1b83c00cb49b7b43ca629328420ce'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.362423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b1b83c00cb49b7b43ca629328420ce'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.373765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b1b83c00cb49b7b43ca629328420ce'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.374882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e1ee4df1-b120-44f6-a2e3-70b29869de0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b1b83c00cb49b7b43ca629328420ce'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:18.399694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 894/1787] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:18 2021] DELETE /identity/v3/users/a6b1b83c00cb49b7b43ca629328420ce => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:18.912249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:18.914687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:18.933946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a29a-1be0-4ee9-847d-6625ad85ca0a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:18.995038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:18.995900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:18.996177 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:18.996450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] PATH_INFO: `/v3/projects/f434f41182a443ddaccc68a31cde7ce3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:18.997635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f434f41182a443ddaccc68a31cde7ce3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:18.999632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.054530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f434f41182a443ddaccc68a31cde7ce3', 'request_id': 'req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:19.060328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f434f41182a443ddaccc68a31cde7ce3', 'request_id': 'req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:19.068313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f434f41182a443ddaccc68a31cde7ce3', 'request_id': 'req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:19.079623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] The token cache is being invalidate because project f434f41182a443ddaccc68a31cde7ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:19.079909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:19.080556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1f6084fb-bdc0-4d93-b9b6-5f14dcb7789f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:19.082149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 894/1788] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:18 2021] DELETE /identity/v3/projects/f434f41182a443ddaccc68a31cde7ce3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:19.089370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.089779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.090158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.109273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:19.110651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:19.188460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 895/1789] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:19.196927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.197933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.198487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.224664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:19.225218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:19.232972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 895/1790] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:19.237953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.252819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822b6d1-d780-407b-a919-05681efa3615 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.258800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.259522 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.259810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.260091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.261607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:19.261607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.263030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.276140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 896/1791] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:19.280418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.292915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45f07-dde9-485a-86ef-a0b563230ff8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.297559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.298427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.298894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.299353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.300216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.303213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.340163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 896/1792] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:19 2021] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:19.345519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.364922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a274-bfb3-4acd-bb9a-8fb90693147d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.451642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.459666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.460188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.460811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.462283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.467452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.500944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 897/1793] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:19 2021] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:19.507683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.521137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76155-6ae0-45d3-b101-b46af155bb26 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.526809 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.527579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.528005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.528410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.529408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.531243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.545095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 897/1794] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:19 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:19.549305 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.562688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cf521-e634-47ff-827b-f0e473460548 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.571971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d325e-8420-4e4e-9f61-d3ca5861fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.573300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d325e-8420-4e4e-9f61-d3ca5861fea5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.573911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d325e-8420-4e4e-9f61-d3ca5861fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.574488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d325e-8420-4e4e-9f61-d3ca5861fea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.575838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d325e-8420-4e4e-9f61-d3ca5861fea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.579101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d325e-8420-4e4e-9f61-d3ca5861fea5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.599331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 898/1795] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:19 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:19.606502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.621799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4acfbd-4eaa-4c72-8676-a53037fc13e5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.628609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.630531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.630971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.631340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] PATH_INFO: `/v3/projects/33aa45845bd34b62b20440b1db2135e8/users/8f0a923e210a46218719f3567a46ab58/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.652201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33aa45845bd34b62b20440b1db2135e8, user_id=8f0a923e210a46218719f3567a46ab58, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.655700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:19.672012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 898/1796] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:19 2021] PUT /identity/v3/projects/33aa45845bd34b62b20440b1db2135e8/users/8f0a923e210a46218719f3567a46ab58/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:19.691140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.692233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.692675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.725367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] MFA Rules not processed for user `8f0a923e210a46218719f3567a46ab58`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:19.726873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:19.800455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 899/1797] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:19 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:19.805555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:19.923228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8c25-b7c8-4d22-8f4a-ac07ed0b6aa7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:19.959990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:19.961187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:19.961635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:19.962146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:19.963037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:19.968223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.014514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 899/1798] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:19 2021] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:20.015185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.030210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17750a-433e-400b-bf47-c5103059bcad None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:20.136881 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:20.137802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.138187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.138574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.139506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:20.142092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.168870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 900/1799] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:20 2021] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:20.173158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.194178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba255187-f9aa-4218-a036-321d45c17093 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:20.203489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:20.204172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.204460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.204784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.205479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:20.207326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.221765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 900/1800] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:20 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:20.226577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.270430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce679e92-9463-4125-bd3b-eec6f2af0b3f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:20.276864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:20.284799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.285090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.286104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] PATH_INFO: `/v3/projects/ad3665d3fba046ab9d744c95735e8f0d/users/d4118372176e42fb906df62e5062953f/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.320445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3665d3fba046ab9d744c95735e8f0d, user_id=d4118372176e42fb906df62e5062953f, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:20.325030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.349215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 901/1801] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:20 2021] PUT /identity/v3/projects/ad3665d3fba046ab9d744c95735e8f0d/users/d4118372176e42fb906df62e5062953f/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:20.353821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.382608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f97dd-e2c7-4ca7-8691-257f12408973 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:20.501995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:20.504101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.504492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.504782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.505587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:20.508466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.526402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 901/1802] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:20 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:20.527764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.538641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10720f43-47e6-4c63-baee-ab2e9594de5c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:20.555612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4633f-7274-4d85-bb35-66f4fce79d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:20.556675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4633f-7274-4d85-bb35-66f4fce79d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.556953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4633f-7274-4d85-bb35-66f4fce79d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.557408 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4633f-7274-4d85-bb35-66f4fce79d43 admin admin] PATH_INFO: `/v3/projects/ad3665d3fba046ab9d744c95735e8f0d/users/d4118372176e42fb906df62e5062953f/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.563832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4633f-7274-4d85-bb35-66f4fce79d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3665d3fba046ab9d744c95735e8f0d, user_id=d4118372176e42fb906df62e5062953f, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:20.569981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4633f-7274-4d85-bb35-66f4fce79d43 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.604868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 902/1803] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:20 2021] PUT /identity/v3/projects/ad3665d3fba046ab9d744c95735e8f0d/users/d4118372176e42fb906df62e5062953f/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:20.605200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.607123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:20.607442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.607731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.608014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.630508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332e02-1a86-48e0-937f-f5805d74631b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:20.657113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] MFA Rules not processed for user `d4118372176e42fb906df62e5062953f`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:20.658576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:20.744908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 903/1804] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:20 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:20.764375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:20.765655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.766282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.766970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] PATH_INFO: `/v3/users/c47fda84d35741b19e6a195f192daba3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.768505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47fda84d35741b19e6a195f192daba3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:20.771764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:20.851466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47fda84d35741b19e6a195f192daba3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:20.861854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47fda84d35741b19e6a195f192daba3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:20.863203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47fda84d35741b19e6a195f192daba3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:20.891905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47fda84d35741b19e6a195f192daba3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:20.909541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0a89532f-b8d9-4e08-b424-4ed284410a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47fda84d35741b19e6a195f192daba3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:20.915199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:20.919495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:20.927639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 902/1805] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:20 2021] DELETE /identity/v3/users/c47fda84d35741b19e6a195f192daba3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:20.929943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:20.930632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:20.931154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:20.988220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:20.990135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:21.107328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d0797-1c70-4898-937b-459b8d33b32e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:21.166433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 903/1806] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:21.177322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:21.179214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:21.195870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:21.196642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:21.196831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:21.197107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:21.201757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:21.299918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:21.299918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:21.302764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523791-e75a-4eb3-a7e5-555e5c94793a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:21.311634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 904/1807] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:20 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:21.313371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510b981-abe7-4075-9453-f63528436d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:21.314050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510b981-abe7-4075-9453-f63528436d1f service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:21.314434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510b981-abe7-4075-9453-f63528436d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:21.314612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510b981-abe7-4075-9453-f63528436d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:21.325195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510b981-abe7-4075-9453-f63528436d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:21.326684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510b981-abe7-4075-9453-f63528436d1f service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:21.347128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 904/1808] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:21.527505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:21.529354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:21.558398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462a3f-7cc8-4b74-aa38-28c7b5044bda service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:21.575049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:21.577824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:21.578740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:21.580838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] PATH_INFO: `/v3/users/8f0a923e210a46218719f3567a46ab58` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:21.585350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0a923e210a46218719f3567a46ab58)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:21.590614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:21.684135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87751f-f7f1-4084-8212-2cd1a6fc6e56 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:21.684448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87751f-f7f1-4084-8212-2cd1a6fc6e56 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:21.685047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87751f-f7f1-4084-8212-2cd1a6fc6e56 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:21.687931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 905/1809] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:41:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 08:41:21.704756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:21.705422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:21.705880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:21.719722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0a923e210a46218719f3567a46ab58'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:21.720484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0a923e210a46218719f3567a46ab58'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:21.732944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0a923e210a46218719f3567a46ab58'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:21.747685 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0a923e210a46218719f3567a46ab58'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:21.748707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f91cdc72-ba30-464d-874b-e23bd0304830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0a923e210a46218719f3567a46ab58'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:21.775667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 905/1810] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:21 2021] DELETE /identity/v3/users/8f0a923e210a46218719f3567a46ab58 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:21.781950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:21.782598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:21.783107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:21.792187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:21.794087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:21.823565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:21.825694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:22.049034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 906/1811] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:22.071930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 906/1812] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:41:21 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:22.084961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:22.087416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:22.198650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:22.205349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:22.299880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40599c24-c0e7-4d39-ba9e-5f45f4b16dcc None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:22.305677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa39ff-0394-420e-bd2a-00496091972a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:22.310930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:22.311975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:22.312908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:22.313984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:22.314330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:22.315099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:22.315536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:22.316355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] PATH_INFO: `/v3/projects/8ab7dba692d74928aa7322ff794d42f3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:22.319605 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab7dba692d74928aa7322ff794d42f3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:22.326168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:22.343430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:22.343430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:22.375407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 907/1813] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:22.514537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab7dba692d74928aa7322ff794d42f3', 'request_id': 'req-36eb442c-94c2-4056-be66-8e0b28678eed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.527888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab7dba692d74928aa7322ff794d42f3', 'request_id': 'req-36eb442c-94c2-4056-be66-8e0b28678eed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.565400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab7dba692d74928aa7322ff794d42f3', 'request_id': 'req-36eb442c-94c2-4056-be66-8e0b28678eed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.615032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] The token cache is being invalidate because project 8ab7dba692d74928aa7322ff794d42f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:22.616631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.619330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.621756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 907/1814] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:22 2021] DELETE /identity/v3/projects/8ab7dba692d74928aa7322ff794d42f3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:22.626010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:22.638138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a23f2-35e4-42c7-8b47-e7e9f08e1e53 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:22.757376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:22.758779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:22.759200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:22.759753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] PATH_INFO: `/v3/users/5d698680897a449b949216bffa2b5eab` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:22.761953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d698680897a449b949216bffa2b5eab)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:22.766191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:22.834347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d698680897a449b949216bffa2b5eab'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.835334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d698680897a449b949216bffa2b5eab'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.845933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d698680897a449b949216bffa2b5eab'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.860989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d698680897a449b949216bffa2b5eab'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.862158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d698680897a449b949216bffa2b5eab'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:22.908702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 908/1815] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:22 2021] DELETE /identity/v3/users/5d698680897a449b949216bffa2b5eab => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:22.927855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:22.931408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:23.083401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb442c-94c2-4056-be66-8e0b28678eed admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:23.227392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:23.229339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:23.250200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:23.252203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:23.252203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:23.253345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:23.257348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:23.286307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:23.289469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:23.343037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 908/1816] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:23.355595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aef6a-982e-499b-8f90-a67778ad2dec admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:23.369557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:23.370728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:23.372469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:23.372982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] PATH_INFO: `/v3/projects/33aa45845bd34b62b20440b1db2135e8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:23.375964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33aa45845bd34b62b20440b1db2135e8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:23.384042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:23.581820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:23.585575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:23.611790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33aa45845bd34b62b20440b1db2135e8', 'request_id': 'req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:23.641560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb87642-c90a-42b0-b228-2330de42a3fa service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:23.642772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33aa45845bd34b62b20440b1db2135e8', 'request_id': 'req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:23.662363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33aa45845bd34b62b20440b1db2135e8', 'request_id': 'req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:23.688674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] The token cache is being invalidate because project 33aa45845bd34b62b20440b1db2135e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:23.689089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:23.689803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:23.694058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 909/1817] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:23 2021] DELETE /identity/v3/projects/33aa45845bd34b62b20440b1db2135e8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:23.698241 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:23.700280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:23.829238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:23.830148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:23.830496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:23.830780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] PATH_INFO: `/v3/projects/07541bdc95a4449da489fac98595d869` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:23.832452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07541bdc95a4449da489fac98595d869)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:23.836000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:23.924584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717f09c-f2dc-46a9-ac9e-96d33bbd2527 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:23.944173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07541bdc95a4449da489fac98595d869', 'request_id': 'req-ad50d701-6a18-4e25-aeb7-2d1154bef757'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:23.968120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07541bdc95a4449da489fac98595d869', 'request_id': 'req-ad50d701-6a18-4e25-aeb7-2d1154bef757'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.004991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07541bdc95a4449da489fac98595d869', 'request_id': 'req-ad50d701-6a18-4e25-aeb7-2d1154bef757'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.035488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] The token cache is being invalidate because project 07541bdc95a4449da489fac98595d869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:24.036959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.039394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad50d701-6a18-4e25-aeb7-2d1154bef757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.042955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 909/1818] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:23 2021] DELETE /identity/v3/projects/07541bdc95a4449da489fac98595d869 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:24.049231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ae06-5725-432c-8916-524398566b64 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.049231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ae06-5725-432c-8916-524398566b64 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.049231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ae06-5725-432c-8916-524398566b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.087932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2d82ae06-5725-432c-8916-524398566b64 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:24.089265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2d82ae06-5725-432c-8916-524398566b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:24.107128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.108956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.108956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.108956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] PATH_INFO: `/v3/users/d4118372176e42fb906df62e5062953f` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.110048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4118372176e42fb906df62e5062953f)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.112459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.202058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 910/1819] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:24.203251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ae06-5725-432c-8916-524398566b64 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:24.205191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2d82ae06-5725-432c-8916-524398566b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:24.220542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4118372176e42fb906df62e5062953f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.221280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4118372176e42fb906df62e5062953f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.232293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4118372176e42fb906df62e5062953f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.241105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ae06-5725-432c-8916-524398566b64 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:24.245783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4118372176e42fb906df62e5062953f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.247294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f86b2af-4c99-47b6-92ff-9e49b7698bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4118372176e42fb906df62e5062953f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.259844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.260770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.263181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.263537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] PATH_INFO: `/v3/users/23f5663ac62347dd8b1399e2b81a46a1` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.267294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f5663ac62347dd8b1399e2b81a46a1)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.271099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.283542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 910/1820] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:23 2021] DELETE /identity/v3/users/d4118372176e42fb906df62e5062953f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:24.286376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.287110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.287621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.327511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:24.329308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:24.406229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 911/1821] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:24.415482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:24.428356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bf60e-4eca-4526-9acc-62b941162200 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:24.433342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f5663ac62347dd8b1399e2b81a46a1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.436272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.437583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.437992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.438614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.439769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:24.440166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.444515 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.446368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f5663ac62347dd8b1399e2b81a46a1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.450118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f5663ac62347dd8b1399e2b81a46a1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.466870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 912/1822] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:41:24.468322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:24.470648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:24.473080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f5663ac62347dd8b1399e2b81a46a1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.484529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8547ba73-e496-49c9-a4ff-7dd44f96eef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f5663ac62347dd8b1399e2b81a46a1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:24.497885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 911/1823] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:24 2021] DELETE /identity/v3/users/23f5663ac62347dd8b1399e2b81a46a1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:24.498449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1fc66-bd3c-4608-a153-6ea4f4a5f2ea admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:24.503149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.503553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.504363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.548636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:24.553234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:24.650903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.652209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.653668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.653804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.654531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.659171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.703213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 912/1824] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:24.715527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 913/1825] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:24 2021] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:24.721256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:24.742459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836d4e7-8e49-437e-a6c4-e7069eba55f5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:24.763938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:24.766158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:24.858952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f400-307b-4c12-b937-94abb3b9fde8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:24.862638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.863664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.864058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.864806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.909366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.910883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.911528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.911935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.913111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.915049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.943625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 913/1826] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:24 2021] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:24.952963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:24.968007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cee76-43f5-4ba9-832a-89a61f8919ff admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:24.974337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:24.975773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:24.975921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.976385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:24.976765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:24.978118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:24.978886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.980321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:24.993193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 914/1827] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:24.997864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 914/1828] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:25.000414 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.016147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce9128-eaff-4676-84dc-525c86ca30b8 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.024074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.024756 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.027483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.028375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.029436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.034543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.035559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.037379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:25.062891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 915/1829] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:24 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:25.063747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.064804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e009e7-bf3c-4eeb-8e8a-d9c4144fa007 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.070937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.071843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.073282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.073566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] PATH_INFO: `/v3/projects/ad3665d3fba046ab9d744c95735e8f0d` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.075656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3665d3fba046ab9d744c95735e8f0d)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.078086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa75bf-44c0-4e1d-bf78-88cdc737d1c6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.081236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.083812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f0b49-8314-4d05-91c3-012a9678715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.084849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0b49-8314-4d05-91c3-012a9678715d admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.085207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0b49-8314-4d05-91c3-012a9678715d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.085764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0b49-8314-4d05-91c3-012a9678715d admin admin] PATH_INFO: `/v3/projects/874b17b224ef45b3aa0f0dd9c715b3b5/users/da2e5a4a53654cf6b4b5e99c89df0ef8/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.103537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f0b49-8314-4d05-91c3-012a9678715d admin admin] RBAC: Authorizing `identity:create_grant(project_id=874b17b224ef45b3aa0f0dd9c715b3b5, user_id=da2e5a4a53654cf6b4b5e99c89df0ef8, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.107059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f0b49-8314-4d05-91c3-012a9678715d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.159309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 916/1830] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:25 2021] PUT /identity/v3/projects/874b17b224ef45b3aa0f0dd9c715b3b5/users/da2e5a4a53654cf6b4b5e99c89df0ef8/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:25.175238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.176618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.176916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.249372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3665d3fba046ab9d744c95735e8f0d', 'request_id': 'req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:25.268893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3665d3fba046ab9d744c95735e8f0d', 'request_id': 'req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:25.274509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] MFA Rules not processed for user `da2e5a4a53654cf6b4b5e99c89df0ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:25.275985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:25.282754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3665d3fba046ab9d744c95735e8f0d', 'request_id': 'req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:25.303597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] The token cache is being invalidate because project ad3665d3fba046ab9d744c95735e8f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:25.304086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:25.304931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1a57fab-7d23-486a-9aa0-4dd3bb5a7293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:25.307273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 915/1831] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:25 2021] DELETE /identity/v3/projects/ad3665d3fba046ab9d744c95735e8f0d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:25.314462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdc4d-9ced-440c-a797-a638c6f188a5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.315042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdc4d-9ced-440c-a797-a638c6f188a5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.317584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdc4d-9ced-440c-a797-a638c6f188a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.354296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6a1bdc4d-9ced-440c-a797-a638c6f188a5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:25.356073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6a1bdc4d-9ced-440c-a797-a638c6f188a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:25.381771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 917/1832] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:25.382969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.384554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:25.453350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 916/1833] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:25.463149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.463704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.464129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.483888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:25.485077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:25.485192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f569-805c-45d4-a6e1-cb220bfe94d0 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.492009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.493081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.493565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.494165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.500073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 917/1834] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:25.500321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.500321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.501977 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.513000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f2368-156e-4356-ac57-7bceda67b688 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.518684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.519464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.519904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.520386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.521180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:25.521487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.523130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.536483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 918/1835] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:25.539226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.550982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 918/1836] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:41:25.555517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.586805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54001-2d6b-4a4a-9c63-71b39c15840a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.702094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f846a4-f4b5-4562-9ae3-69d161c7b350 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.714566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.715754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.716244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.716736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.718597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.723583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.730217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.731053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.731410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.731757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.732711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.735025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.789372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 919/1837] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:25.798176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 919/1838] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:25.802567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.805787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.829713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d5dbb-8bd4-4d0f-9c47-b8345d20f840 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.901961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0f6fe-49d5-4e5d-aaf4-12afc465a4f6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.907477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.907979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.908473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.908854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.910091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.911569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.913384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.913979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.914454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.915098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.915728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.918336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.936287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 920/1839] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:25 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:25.937597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.940488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:25.940664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 920/1840] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:25 2021] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:25.941672 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.952658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dece43c-080f-4c49-b41e-e4c8586456b0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.955666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d91ad-c2a8-4328-9de4-a97ef0f70bb9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.959839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.960594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.960949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.961306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.962123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.963806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.965728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.966857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.967250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.967602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] PATH_INFO: `/v3/projects/c6702d3228b8448a8a35cd08e4eb9f05` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.968883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6702d3228b8448a8a35cd08e4eb9f05)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.970995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:25.977675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 921/1841] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:25 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:25.978570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:25.988825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd18a1-cd84-4537-9b59-169d35759fd2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:25.993691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:25.994464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:25.994830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:25.995239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:25.996224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:25.997946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.011037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 922/1842] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:25 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:26.014264 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.024561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195d0e-380d-4c8c-85b9-c3b6e046adaa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.029079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.030112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.030471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.030829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] PATH_INFO: `/v3/projects/7d2b027a1a844940816c59a8378a4a33/users/d84847b66478498f888b8fde2c8e882a/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.048233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2b027a1a844940816c59a8378a4a33, user_id=d84847b66478498f888b8fde2c8e882a, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.049562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6702d3228b8448a8a35cd08e4eb9f05', 'request_id': 'req-03ec9fe6-7539-472e-ba16-aaccdd9ea771'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.051317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.055866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6702d3228b8448a8a35cd08e4eb9f05', 'request_id': 'req-03ec9fe6-7539-472e-ba16-aaccdd9ea771'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.064989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6702d3228b8448a8a35cd08e4eb9f05', 'request_id': 'req-03ec9fe6-7539-472e-ba16-aaccdd9ea771'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.077207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 923/1843] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:26 2021] PUT /identity/v3/projects/7d2b027a1a844940816c59a8378a4a33/users/d84847b66478498f888b8fde2c8e882a/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:26.077207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.089675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] The token cache is being invalidate because project c6702d3228b8448a8a35cd08e4eb9f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:26.090004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.091340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03ec9fe6-7539-472e-ba16-aaccdd9ea771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.093464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 921/1844] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:25 2021] DELETE /identity/v3/projects/c6702d3228b8448a8a35cd08e4eb9f05 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:26.095226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.096347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.096956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.142134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] MFA Rules not processed for user `d84847b66478498f888b8fde2c8e882a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:26.143370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.172465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91a90-7703-4b37-b866-917f3c0bbf2a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.178150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.178828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.179223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.179669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.180539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.182158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.193183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 924/1845] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:26 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:26.194019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.195673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.207631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd92a8-908d-4d19-ac28-4f648be92b27 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.212458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.213447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.213618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.213894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] PATH_INFO: `/v3/users/ba7fc6fc233847c3afec319da293e9dc` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.215181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7fc6fc233847c3afec319da293e9dc)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.216994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 922/1846] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:26 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:26.217105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.217784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.219089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.231949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c4177-561c-4845-bb66-0f4654b28735 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.238605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.239637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.239924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.240299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] PATH_INFO: `/v3/projects/17802dbbf16b426db2e0cf21cfbc5490/users/4984452815914ec3987ff3cb68bf969e/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.261701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17802dbbf16b426db2e0cf21cfbc5490, user_id=4984452815914ec3987ff3cb68bf969e, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.267964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.284668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7fc6fc233847c3afec319da293e9dc'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.289732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 923/1847] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:26 2021] PUT /identity/v3/projects/17802dbbf16b426db2e0cf21cfbc5490/users/4984452815914ec3987ff3cb68bf969e/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:26.290723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.292960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.310340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7fc6fc233847c3afec319da293e9dc'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.311136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7fc6fc233847c3afec319da293e9dc'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.328229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7fc6fc233847c3afec319da293e9dc'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.340376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8a6a7666-9cb8-445d-9d36-8ffe58b7edda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7fc6fc233847c3afec319da293e9dc'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:26.350607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 925/1848] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:26 2021] DELETE /identity/v3/users/ba7fc6fc233847c3afec319da293e9dc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:26.352504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.352867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.353211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.403728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091decb5-f45e-4a8b-85ef-e51e60c74df9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.413148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] MFA Rules not processed for user `4984452815914ec3987ff3cb68bf969e`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:26.414596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.520129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.524949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.525503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.525802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.527072 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.530298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.592770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 924/1849] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:26 2021] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:26.597280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.603258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 926/1850] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:26 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:26.604689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.604829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.606099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:26.634882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f8490-e7a5-4dbb-9bb3-321effa2001c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.739037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.739266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.739513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.739754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.740556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.742832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.764308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d30db-71ca-4e56-8bc0-19b0c7e3b4b8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.773551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.774736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.775815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.776478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.777699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.781454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.814467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 927/1851] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:26 2021] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:26.818104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.835906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 925/1852] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:26 2021] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:26.838409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.865089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3aed-169e-4b6f-9ee6-46d88b6e96af admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.958593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4120a-3501-4f24-b5ec-bce79b236c7a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:26.965059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.965754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.966038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.966346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.967052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.969357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.974303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:26.975456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:26.976011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:26.976494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:26.977759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:26.981039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:26.993393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 926/1853] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:26 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:26.995557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 928/1854] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:26 2021] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:26.999285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:26.999546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.009871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8cf20-f3fc-4b29-b236-c1c7827bcb5e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.011803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee856-1f0a-4b0e-a850-a42d9f4d7efc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.014428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.015652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.015940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.016219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] PATH_INFO: `/v3/projects/751a448285ad4a9cb6417235dcddcb9a/users/34a2eda0b7a644afb2959e2973941398/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.019203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.020465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.020751 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.021045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.021981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.023666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.034608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=751a448285ad4a9cb6417235dcddcb9a, user_id=34a2eda0b7a644afb2959e2973941398, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.036949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 929/1855] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:26 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:27.038157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.041192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.051754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2468-1f8c-462a-8717-037944fbda0f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.062192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 927/1856] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:26 2021] PUT /identity/v3/projects/751a448285ad4a9cb6417235dcddcb9a/users/34a2eda0b7a644afb2959e2973941398/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:27.062834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.064532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.118805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.119896 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.120185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.120460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] PATH_INFO: `/v3/projects/826c783a88df4fb9a4c56bf607c9a468/users/ba94e22077bd479da7bc2b760a5bed28/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.136666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826c783a88df4fb9a4c56bf607c9a468, user_id=ba94e22077bd479da7bc2b760a5bed28, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.139390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.146977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d9ef-d16b-4cf8-9520-e9795c5e7bae admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.152808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.153726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.154008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.154276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] PATH_INFO: `/v3/projects/1af31a5f9eb1484c8489ee3ab6c39ca6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.155522 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af31a5f9eb1484c8489ee3ab6c39ca6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.158707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 930/1857] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:27 2021] PUT /identity/v3/projects/826c783a88df4fb9a4c56bf607c9a468/users/ba94e22077bd479da7bc2b760a5bed28/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:27.158707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.158898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.257513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af31a5f9eb1484c8489ee3ab6c39ca6', 'request_id': 'req-52c62202-dec9-4cde-8c70-000a5daf1460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:27.265714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af31a5f9eb1484c8489ee3ab6c39ca6', 'request_id': 'req-52c62202-dec9-4cde-8c70-000a5daf1460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:27.272342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42ff6-1aea-4a6f-ab67-0b8f8d7b4fa6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.276816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af31a5f9eb1484c8489ee3ab6c39ca6', 'request_id': 'req-52c62202-dec9-4cde-8c70-000a5daf1460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:27.291991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] The token cache is being invalidate because project 1af31a5f9eb1484c8489ee3ab6c39ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:27.292589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:27.293482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:27.296089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 928/1858] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:27 2021] DELETE /identity/v3/projects/1af31a5f9eb1484c8489ee3ab6c39ca6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:27.297139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.298670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.362322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c98520-3b93-4812-a496-e40a27fa0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.363907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c98520-3b93-4812-a496-e40a27fa0c86 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.364496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c98520-3b93-4812-a496-e40a27fa0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.365242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c98520-3b93-4812-a496-e40a27fa0c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.367163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c98520-3b93-4812-a496-e40a27fa0c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.372189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c98520-3b93-4812-a496-e40a27fa0c86 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.389018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62202-dec9-4cde-8c70-000a5daf1460 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.396663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.397627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.397795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.398071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.398822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.400547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.402173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 931/1859] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:27 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:27.404038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.404419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.404771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.416809 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 929/1860] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:27 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:27.417902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.420017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.428447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:27.428962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.436040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2706d46-9269-4937-a735-b35dac4bd443 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.437966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 932/1861] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:27.439067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.441951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562ee8-7fa4-49c5-9651-544ef95af87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.443260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562ee8-7fa4-49c5-9651-544ef95af87a admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.443618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562ee8-7fa4-49c5-9651-544ef95af87a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.443952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562ee8-7fa4-49c5-9651-544ef95af87a admin admin] PATH_INFO: `/v3/projects/751a448285ad4a9cb6417235dcddcb9a/users/34a2eda0b7a644afb2959e2973941398/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.446099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9562ee8-7fa4-49c5-9651-544ef95af87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=751a448285ad4a9cb6417235dcddcb9a, user_id=34a2eda0b7a644afb2959e2973941398, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.450655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9562ee8-7fa4-49c5-9651-544ef95af87a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.450865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac384-8726-40c6-9108-a101fe2fd064 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.457814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f1a3f-138c-46d6-813e-1860f0a7a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.458748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f1a3f-138c-46d6-813e-1860f0a7a070 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.459072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f1a3f-138c-46d6-813e-1860f0a7a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.459352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f1a3f-138c-46d6-813e-1860f0a7a070 admin admin] PATH_INFO: `/v3/projects/826c783a88df4fb9a4c56bf607c9a468/users/ba94e22077bd479da7bc2b760a5bed28/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.461602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f1a3f-138c-46d6-813e-1860f0a7a070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826c783a88df4fb9a4c56bf607c9a468, user_id=ba94e22077bd479da7bc2b760a5bed28, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.466211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f1a3f-138c-46d6-813e-1860f0a7a070 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.487487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 933/1863] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:27 2021] PUT /identity/v3/projects/826c783a88df4fb9a4c56bf607c9a468/users/ba94e22077bd479da7bc2b760a5bed28/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:27.487487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf29e89-6874-4862-b588-8912af7fc7ef None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.487487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf29e89-6874-4862-b588-8912af7fc7ef None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.487487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf29e89-6874-4862-b588-8912af7fc7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.487891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 930/1863] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:27 2021] PUT /identity/v3/projects/751a448285ad4a9cb6417235dcddcb9a/users/34a2eda0b7a644afb2959e2973941398/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:27.490698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.490698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.490698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.508364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-adf29e89-6874-4862-b588-8912af7fc7ef None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:27.509770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-adf29e89-6874-4862-b588-8912af7fc7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.528877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] MFA Rules not processed for user `34a2eda0b7a644afb2959e2973941398`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:27.530082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.608056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 934/1864] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:27.609492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.609746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.611140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.642865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 931/1865] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:27 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:27.646061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.661242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] MFA Rules not processed for user `ba94e22077bd479da7bc2b760a5bed28`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:27.662693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.673484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c94d44-1018-486c-8e31-d3a1705f2757 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.681729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.682527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.682896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.683504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.684399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:27.684783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.688006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.712519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 932/1866] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:27.713537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.715289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.758811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 935/1867] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:27 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:27.759781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.781726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd6b5-b0a6-4397-af23-5e9740e97282 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.787394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.788078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.788367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.788734 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.789431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.791372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.799028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db91e5-e2f2-4d91-ab85-c44d9838af2e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.803851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.804872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.805166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.805445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.816022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.820387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:27.822538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 936/1868] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:27 2021] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:27.823458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.825190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:27.834170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 933/1869] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:27 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:27.835635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:27.848293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925764-5033-4c71-8dd6-48e2c9e49c67 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.953452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a471-fa30-469b-8feb-9d3460aaea3a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:27.961792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.962944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.963237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.966583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.975825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:27.978578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:27.978950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:27.979223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:27.979952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:27.981916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.034287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 934/1870] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:27 2021] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:28.038514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:28.056817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31001d3-9aa1-4ea6-8e64-ff8c53848209 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:28.081888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:28.085644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:28.085960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:28.086248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:28.088838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:28.093585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.123325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 935/1871] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:28 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:28.124012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:28.137476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:28.139654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.150582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9c13-270c-43bb-ad65-dfb7d63bea4a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:28.164315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:28.165095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:28.165420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:28.165712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:28.166698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:28.167731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 937/1872] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:27 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:28.174876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.208078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 936/1873] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:28 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:28.211827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:28.230846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab9a64-99d6-4ec8-9f55-ef1dd2d80004 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:28.254309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a6898-7956-44da-8b5a-5d07fe8dac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:28.255489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a6898-7956-44da-8b5a-5d07fe8dac45 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:28.256164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a6898-7956-44da-8b5a-5d07fe8dac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:28.257118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a6898-7956-44da-8b5a-5d07fe8dac45 admin admin] PATH_INFO: `/v3/projects/d3ee953307754e2aba210e4cae85d6ea/users/ab5f4d9229e04c21a3bfdfad14a5d7e5/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:28.278560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a6898-7956-44da-8b5a-5d07fe8dac45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ee953307754e2aba210e4cae85d6ea, user_id=ab5f4d9229e04c21a3bfdfad14a5d7e5, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:28.282484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a6898-7956-44da-8b5a-5d07fe8dac45 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.290563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:28.310396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb910d-2f79-43d9-b53e-0652570da1cd admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:28.340050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 938/1874] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:28 2021] PUT /identity/v3/projects/d3ee953307754e2aba210e4cae85d6ea/users/ab5f4d9229e04c21a3bfdfad14a5d7e5/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:28.353918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:28.354263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:28.355914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:28.417199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:28.418143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:28.418741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:28.419193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:28.422192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:28.423769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] MFA Rules not processed for user `ab5f4d9229e04c21a3bfdfad14a5d7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:28.427773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:28.523165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:28.524886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.536823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 937/1875] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:28 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:28.550232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 939/1876] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:28 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:28.668468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:28.678023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50fbd3-bebd-48f2-ad84-cc2872aae94d service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:28.683127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a36c9-833f-4ba8-8714-431f4f373eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:28.684002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a36c9-833f-4ba8-8714-431f4f373eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:28.684357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a36c9-833f-4ba8-8714-431f4f373eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:28.684839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a36c9-833f-4ba8-8714-431f4f373eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:28.698735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a36c9-833f-4ba8-8714-431f4f373eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:28.700699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a36c9-833f-4ba8-8714-431f4f373eb0 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:28.713016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 938/1877] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:28 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:29.361820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:29.425380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7144002-821e-4b04-8acd-8a0ca33b6e3f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:29.430451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:29.431366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:29.431650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:29.431922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] PATH_INFO: `/v3/users/4984452815914ec3987ff3cb68bf969e` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:29.433443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4984452815914ec3987ff3cb68bf969e)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:29.435603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:29.485037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4984452815914ec3987ff3cb68bf969e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:29.493784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4984452815914ec3987ff3cb68bf969e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:29.494561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4984452815914ec3987ff3cb68bf969e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:29.509462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4984452815914ec3987ff3cb68bf969e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:29.518196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4984452815914ec3987ff3cb68bf969e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:29.526579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 940/1878] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:29 2021] DELETE /identity/v3/users/4984452815914ec3987ff3cb68bf969e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:29.531249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:29.531581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:29.531863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:29.551632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:29.552866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:29.621239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 939/1879] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:29.632536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:29.634029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:29.706270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f283c5-6fc5-4b36-a40f-c37bc8d7b119 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:29.711109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:29.711774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:29.712058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:29.712360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:29.721939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:29.723533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:29.739828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 941/1880] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:30.045492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:30.047704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:30.066700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b9db-8bbb-4426-937a-d2fb01d9a1b3 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:30.071442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:30.072346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.072632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.072909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] PATH_INFO: `/v3/projects/17802dbbf16b426db2e0cf21cfbc5490` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.074459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17802dbbf16b426db2e0cf21cfbc5490)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:30.076584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:30.137044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17802dbbf16b426db2e0cf21cfbc5490', 'request_id': 'req-0dc18346-c475-4216-baa0-b48f40a12030'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.143081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17802dbbf16b426db2e0cf21cfbc5490', 'request_id': 'req-0dc18346-c475-4216-baa0-b48f40a12030'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.156409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17802dbbf16b426db2e0cf21cfbc5490', 'request_id': 'req-0dc18346-c475-4216-baa0-b48f40a12030'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.173252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] The token cache is being invalidate because project 17802dbbf16b426db2e0cf21cfbc5490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:30.173555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.177298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.178846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 940/1881] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:30 2021] DELETE /identity/v3/projects/17802dbbf16b426db2e0cf21cfbc5490 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:30.182697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:30.191803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92916fb7-c139-4d97-b38f-6df40ad154dd service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:30.248081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:30.249068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.249360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.250965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] PATH_INFO: `/v3/users/ba94e22077bd479da7bc2b760a5bed28` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.250965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba94e22077bd479da7bc2b760a5bed28)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:30.253220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:30.301973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba94e22077bd479da7bc2b760a5bed28'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.308814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba94e22077bd479da7bc2b760a5bed28'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.309503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba94e22077bd479da7bc2b760a5bed28'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.328865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba94e22077bd479da7bc2b760a5bed28'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.336947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-13adaaf2-6dcc-40c4-8c66-e5d4b302fccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba94e22077bd479da7bc2b760a5bed28'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.345195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 942/1882] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:30 2021] DELETE /identity/v3/users/ba94e22077bd479da7bc2b760a5bed28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:30.634378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:30.635888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:30.653271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc18346-c475-4216-baa0-b48f40a12030 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:30.707768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:30.708627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.708901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.709173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] PATH_INFO: `/v3/projects/826c783a88df4fb9a4c56bf607c9a468` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.710342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826c783a88df4fb9a4c56bf607c9a468)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:30.712373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:30.757332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826c783a88df4fb9a4c56bf607c9a468', 'request_id': 'req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.762894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826c783a88df4fb9a4c56bf607c9a468', 'request_id': 'req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.770318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826c783a88df4fb9a4c56bf607c9a468', 'request_id': 'req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.781200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] The token cache is being invalidate because project 826c783a88df4fb9a4c56bf607c9a468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:30.781439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.782074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aaf4c9c2-baf8-4b69-8d99-4ee26d86bee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:30.783649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 941/1883] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:30 2021] DELETE /identity/v3/projects/826c783a88df4fb9a4c56bf607c9a468 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:30.789738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.790206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.790310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.807672 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:30.808817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:30.866179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 943/1884] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:30.874905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.875226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.875511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.895139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:30.896129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:30.903587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 942/1885] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:30.907796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:30.917377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fc540-aaad-4f2f-8343-27f0de097366 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:30.922410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:30.923115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.923446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.923751 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.924479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:30.924875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:30.926632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:30.939321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 944/1886] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:30.944193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:30.953190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa7a35-5f03-4c0b-8a0a-093f1eb5fb3c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:30.960834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:30.961512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:30.961798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:30.962085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:30.962792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:30.964759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:30.990454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 943/1887] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:30 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:30.994503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.004578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e126b-941a-44eb-be7e-785f502b90aa admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.058627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.059432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.059721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.060004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.060708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.062655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.084719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 945/1888] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:30 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:31.089061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.101735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c72fd-6321-42b1-8f3d-30c1c9f2caef admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.109053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.109815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.110102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.110453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.111243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.113453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.125408 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 944/1889] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:31.130673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.140121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cde8ce-d6ae-41bb-8d27-ce549181c418 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.144674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e255b4-6568-4378-be30-76af3dab7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.145368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e255b4-6568-4378-be30-76af3dab7b81 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.145654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e255b4-6568-4378-be30-76af3dab7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.145935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e255b4-6568-4378-be30-76af3dab7b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.146661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e255b4-6568-4378-be30-76af3dab7b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.148351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e255b4-6568-4378-be30-76af3dab7b81 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.162473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 946/1890] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:31.163681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.172970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4861-b05e-41df-ab22-94ae306205db admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.178289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.179227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.179837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.179953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] PATH_INFO: `/v3/projects/58161211ebf948d6ac0b3b1b2ab25aca/users/de17f472974246ec9919ae5ff7ba14c6/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.197878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58161211ebf948d6ac0b3b1b2ab25aca, user_id=de17f472974246ec9919ae5ff7ba14c6, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.200697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.215943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 945/1891] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:31 2021] PUT /identity/v3/projects/58161211ebf948d6ac0b3b1b2ab25aca/users/de17f472974246ec9919ae5ff7ba14c6/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:31.226953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.227205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.227496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.262721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] MFA Rules not processed for user `de17f472974246ec9919ae5ff7ba14c6`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:31.263931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:31.337640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 947/1892] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:31 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:31.347678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.349574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:31.424366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0e616-d898-4284-8039-06515170dcd6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.429979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58118c-c9ea-4a74-8c23-e0bd957c9b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.430801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58118c-c9ea-4a74-8c23-e0bd957c9b08 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.431123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58118c-c9ea-4a74-8c23-e0bd957c9b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.431431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58118c-c9ea-4a74-8c23-e0bd957c9b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.440444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58118c-c9ea-4a74-8c23-e0bd957c9b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.442821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58118c-c9ea-4a74-8c23-e0bd957c9b08 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.451851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 946/1893] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:31 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:31.475187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.575830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948784bb-60bc-46ff-bedb-afc6edaf6b82 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.581367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.583144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.583465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.583749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] PATH_INFO: `/v3/users/de17f472974246ec9919ae5ff7ba14c6` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.585003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de17f472974246ec9919ae5ff7ba14c6)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.587010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.646821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de17f472974246ec9919ae5ff7ba14c6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:31.654126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de17f472974246ec9919ae5ff7ba14c6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:31.655009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de17f472974246ec9919ae5ff7ba14c6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:31.667750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de17f472974246ec9919ae5ff7ba14c6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:31.675172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de17f472974246ec9919ae5ff7ba14c6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:31.682364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 948/1894] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:31 2021] DELETE /identity/v3/users/de17f472974246ec9919ae5ff7ba14c6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:31.686998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.687486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.687580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.705810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:31.707811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:31.793913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 947/1895] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:31.804377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:31.805786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:31.868427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fbac5-5c74-4f77-96e9-25d195952cd9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:31.872063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48de1c1-52cd-4609-b1ee-4e3b491ff123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:31.872729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de1c1-52cd-4609-b1ee-4e3b491ff123 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:31.873021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de1c1-52cd-4609-b1ee-4e3b491ff123 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:31.873302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de1c1-52cd-4609-b1ee-4e3b491ff123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:31.884051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48de1c1-52cd-4609-b1ee-4e3b491ff123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:31.885524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48de1c1-52cd-4609-b1ee-4e3b491ff123 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:31.895538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 949/1896] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:32.301771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.303271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:32.317875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc0c09-baeb-44ab-93d5-2e4f1817c06e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.322672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.323688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.324041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.324446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] PATH_INFO: `/v3/projects/58161211ebf948d6ac0b3b1b2ab25aca` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.334238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58161211ebf948d6ac0b3b1b2ab25aca)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.337039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.396880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58161211ebf948d6ac0b3b1b2ab25aca', 'request_id': 'req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:32.402567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58161211ebf948d6ac0b3b1b2ab25aca', 'request_id': 'req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:32.412569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58161211ebf948d6ac0b3b1b2ab25aca', 'request_id': 'req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:32.429144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] The token cache is being invalidate because project 58161211ebf948d6ac0b3b1b2ab25aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:32.429232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:32.429937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ce12d6e1-c6f3-45f0-a122-be7e5594c55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:32.432834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 948/1897] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:32 2021] DELETE /identity/v3/projects/58161211ebf948d6ac0b3b1b2ab25aca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:32.437597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.437834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.438023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.466829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:32.468042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:32.546496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 950/1898] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:32.555431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.555718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.555996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.575832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:32.577019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:32.585332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 949/1899] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:32.589569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.598954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4826b02-00ca-424b-aa58-2fca510f1a31 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.603888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.604554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.604835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.605111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.605844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:32.606150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.607790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.621150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 951/1900] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:32.625992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.635927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2145e99-c959-4f41-86a9-51f6bc11fb70 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.640677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.641484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.641834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.642179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.643076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.645802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.676220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 950/1901] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:32 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:32.680558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.690236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992350c-2a2e-4a76-8b6f-08e78d5073c0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.757807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.758685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.758995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.759270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.759966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.761897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.787721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 952/1902] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:32 2021] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:32.793470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.803436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e71b06-79a8-4275-9477-5a812948b7f3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.807843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.808502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.808787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.809054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.809776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.811400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.823325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 951/1903] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:32.827691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.838824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc91c-8eb8-41f6-8f0c-f738d8cbb664 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.844018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331f79f-6f9d-4384-aa4f-c6a73838f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.845160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331f79f-6f9d-4384-aa4f-c6a73838f179 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.845612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331f79f-6f9d-4384-aa4f-c6a73838f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.845904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331f79f-6f9d-4384-aa4f-c6a73838f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.847219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331f79f-6f9d-4384-aa4f-c6a73838f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.849890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331f79f-6f9d-4384-aa4f-c6a73838f179 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.860691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 953/1904] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:32.864879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:32.874409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6394c-99ab-46bd-8d85-bd13f80d0f97 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:32.886149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:32.887088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.887393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.887653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] PATH_INFO: `/v3/projects/09ece28a1a934c508b506160a96d83ae/users/a0ade7539c244b169a26efbf72708c6b/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.903801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ece28a1a934c508b506160a96d83ae, user_id=a0ade7539c244b169a26efbf72708c6b, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:32.906538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:32.920425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 952/1905] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:32 2021] PUT /identity/v3/projects/09ece28a1a934c508b506160a96d83ae/users/a0ade7539c244b169a26efbf72708c6b/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:32.931963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:32.932253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:32.932531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:32.968632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] MFA Rules not processed for user `a0ade7539c244b169a26efbf72708c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:32.969812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:33.035014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 954/1906] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:33.039628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.100842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb612b-e3ab-4c16-a4c1-debda1602d30 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.105437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.106191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.106476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.106760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.107495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.109428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.139824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 953/1907] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:33 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:33.144963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.155478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955ce0-13bb-471b-a1dc-115b6dec42d8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.211636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.212291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.212632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.212913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.213614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.215571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.238886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 955/1908] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:33 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:33.243616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.254292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d251-cd30-41bc-a83c-da753caa2f5b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.258744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.259464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.259753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.260031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.260760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.262381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.273212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 954/1909] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:33.277858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.288549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6282-5a4f-498c-96fe-1c1614db75a9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.293634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.294539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.294826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.295141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] PATH_INFO: `/v3/projects/f96c8aafdf0d4f0ba2b7684e134d1fb7/users/74d7bc2fc4c34b058736510806922229/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.313978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96c8aafdf0d4f0ba2b7684e134d1fb7, user_id=74d7bc2fc4c34b058736510806922229, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.317336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.338055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 956/1910] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:33 2021] PUT /identity/v3/projects/f96c8aafdf0d4f0ba2b7684e134d1fb7/users/74d7bc2fc4c34b058736510806922229/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:33.344188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.357241 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaa99f-e2c1-48b4-829f-d42ce8004f88 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.422589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd3a3f-c621-41ea-be5a-4198e5a17063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.423328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd3a3f-c621-41ea-be5a-4198e5a17063 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.423613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd3a3f-c621-41ea-be5a-4198e5a17063 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.423889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd3a3f-c621-41ea-be5a-4198e5a17063 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.424625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd3a3f-c621-41ea-be5a-4198e5a17063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.433717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd3a3f-c621-41ea-be5a-4198e5a17063 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.438938 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 955/1911] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:33 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:33.444606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.454570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6e94c-ac26-44a3-ac98-78715de22158 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.459972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.460881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.461160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.461440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] PATH_INFO: `/v3/projects/f96c8aafdf0d4f0ba2b7684e134d1fb7/users/74d7bc2fc4c34b058736510806922229/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.463448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96c8aafdf0d4f0ba2b7684e134d1fb7, user_id=74d7bc2fc4c34b058736510806922229, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.466068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.476821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 957/1912] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:33 2021] PUT /identity/v3/projects/f96c8aafdf0d4f0ba2b7684e134d1fb7/users/74d7bc2fc4c34b058736510806922229/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:33.487104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.487395 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.487674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.523646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] MFA Rules not processed for user `74d7bc2fc4c34b058736510806922229`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:33.524868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:33.613693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 956/1913] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:33 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:33.623786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:33.625549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:33.696189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c42d26-0c85-4459-8e1f-cfbffd3a0375 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:33.700121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:33.700772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:33.701057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:33.701332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:33.774891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:33.776539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:33.786764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 958/1914] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:33 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:40.557154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:40.558832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:40.679354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc50d3a-e42a-48d9-93fc-146d86ee8b07 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:40.684266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:40.685303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:40.685658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:40.686033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] PATH_INFO: `/v3/users/da2e5a4a53654cf6b4b5e99c89df0ef8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:40.688770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2e5a4a53654cf6b4b5e99c89df0ef8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:40.695815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:40.748215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:40.760641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379f66-f1be-4273-919c-97aa98712c66 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:40.766877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:40.768627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:40.768925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:40.769421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] PATH_INFO: `/v3/users/a0ade7539c244b169a26efbf72708c6b` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:40.770457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2e5a4a53654cf6b4b5e99c89df0ef8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.771334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2e5a4a53654cf6b4b5e99c89df0ef8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.772059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ade7539c244b169a26efbf72708c6b)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:40.774807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:40.781129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2e5a4a53654cf6b4b5e99c89df0ef8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.795578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2e5a4a53654cf6b4b5e99c89df0ef8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.796562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7208e293-e6bf-48de-b47f-6cf3dcf7cc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2e5a4a53654cf6b4b5e99c89df0ef8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.822461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 957/1915] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:40 2021] DELETE /identity/v3/users/da2e5a4a53654cf6b4b5e99c89df0ef8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:40.824432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:40.824815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:40.825250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:40.846785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ade7539c244b169a26efbf72708c6b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.847023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:40.848982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:40.857827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ade7539c244b169a26efbf72708c6b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.858791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ade7539c244b169a26efbf72708c6b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.875405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ade7539c244b169a26efbf72708c6b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.888677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e6bd3266-31ec-4446-9469-2648ebb39596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ade7539c244b169a26efbf72708c6b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:40.897721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 959/1916] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:40 2021] DELETE /identity/v3/users/a0ade7539c244b169a26efbf72708c6b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:40.902724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:40.903304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:40.903888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:40.932542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:40.934336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:40.936253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 958/1917] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:40.949417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:40.951752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:41.013567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 960/1918] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:41.023726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:41.026045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30f9cb-d70b-4ff9-9cac-1433fe3d60ec None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:41.079528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:41.080408 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:41.080808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:41.081182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:41.083242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ccc26-ceab-4771-8384-c7fdb506393d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:41.087581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:41.088224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:41.088585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:41.088858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:41.093887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:41.096072 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:41.098001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:41.099882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:41.109715 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 961/1919] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:41.118334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 959/1920] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:41.497559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:41.499015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:41.513592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797c4e-9963-4275-bed3-1e476904b5b1 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:41.526480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:41.527262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:41.527553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:41.527882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] PATH_INFO: `/v3/projects/09ece28a1a934c508b506160a96d83ae` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:41.529417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ece28a1a934c508b506160a96d83ae)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:41.531940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:41.611543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ece28a1a934c508b506160a96d83ae', 'request_id': 'req-0acf0ad5-4637-4730-8169-cc59d2372dc2'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.618689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ece28a1a934c508b506160a96d83ae', 'request_id': 'req-0acf0ad5-4637-4730-8169-cc59d2372dc2'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.629557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ece28a1a934c508b506160a96d83ae', 'request_id': 'req-0acf0ad5-4637-4730-8169-cc59d2372dc2'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.651601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] The token cache is being invalidate because project 09ece28a1a934c508b506160a96d83ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:41.651996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.652897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.654816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 962/1921] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:41 2021] DELETE /identity/v3/projects/09ece28a1a934c508b506160a96d83ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:41.658736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:41.671586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84994d-3900-4e49-8eb2-fb9d3a51e004 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:41.782991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:41.784218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:41.784648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:41.785222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] PATH_INFO: `/v3/users/74d7bc2fc4c34b058736510806922229` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:41.787465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d7bc2fc4c34b058736510806922229)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:41.789752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:41.875010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d7bc2fc4c34b058736510806922229'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.875943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d7bc2fc4c34b058736510806922229'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.886166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d7bc2fc4c34b058736510806922229'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.898715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d7bc2fc4c34b058736510806922229'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.899898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d7bc2fc4c34b058736510806922229'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:41.932065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 960/1922] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:41 2021] DELETE /identity/v3/users/74d7bc2fc4c34b058736510806922229 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:42.274577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.276044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:42.293714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0ad5-4637-4730-8169-cc59d2372dc2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:42.380649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:42.381703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.382000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.382322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] PATH_INFO: `/v3/projects/f96c8aafdf0d4f0ba2b7684e134d1fb7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.383542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96c8aafdf0d4f0ba2b7684e134d1fb7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:42.385558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:42.435885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.437425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:42.439351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96c8aafdf0d4f0ba2b7684e134d1fb7', 'request_id': 'req-facacff8-27f7-42b6-ab82-9f07244f778c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.445712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96c8aafdf0d4f0ba2b7684e134d1fb7', 'request_id': 'req-facacff8-27f7-42b6-ab82-9f07244f778c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.450015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bd9ff-94b4-4bcf-bc52-8b1269bb26af admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:42.454033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96c8aafdf0d4f0ba2b7684e134d1fb7', 'request_id': 'req-facacff8-27f7-42b6-ab82-9f07244f778c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.469719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] The token cache is being invalidate because project f96c8aafdf0d4f0ba2b7684e134d1fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:42.470007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.470827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-facacff8-27f7-42b6-ab82-9f07244f778c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.474271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 963/1923] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:42 2021] DELETE /identity/v3/projects/f96c8aafdf0d4f0ba2b7684e134d1fb7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:42.479756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bd07-67c3-4087-9a69-a8b7320f75ea None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.480044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bd07-67c3-4087-9a69-a8b7320f75ea None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.480317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bd07-67c3-4087-9a69-a8b7320f75ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.501917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b6b5bd07-67c3-4087-9a69-a8b7320f75ea None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:42.503706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b6b5bd07-67c3-4087-9a69-a8b7320f75ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:42.525253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:42.526459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.526976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.527428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] PATH_INFO: `/v3/projects/874b17b224ef45b3aa0f0dd9c715b3b5` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.528726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874b17b224ef45b3aa0f0dd9c715b3b5)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:42.530828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:42.570053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 964/1924] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:42.577873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.578162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.578441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.593619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874b17b224ef45b3aa0f0dd9c715b3b5', 'request_id': 'req-8cbf762e-2f17-404d-8b69-325c10d88a20'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.597593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:42.599409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:42.600724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874b17b224ef45b3aa0f0dd9c715b3b5', 'request_id': 'req-8cbf762e-2f17-404d-8b69-325c10d88a20'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.612836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874b17b224ef45b3aa0f0dd9c715b3b5', 'request_id': 'req-8cbf762e-2f17-404d-8b69-325c10d88a20'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.625894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] The token cache is being invalidate because project 874b17b224ef45b3aa0f0dd9c715b3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:42.626262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.627034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.629217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 961/1925] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:42 2021] DELETE /identity/v3/projects/874b17b224ef45b3aa0f0dd9c715b3b5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:42.633344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.638378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:42.673193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 965/1926] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:42.674130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.685758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f39a6-e609-438c-936c-7282aafabfb5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:42.692395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:42.693162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.695258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.695553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.696337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:42.696646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:42.701980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:42.714319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf762e-2f17-404d-8b69-325c10d88a20 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:42.718832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 966/1927] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:42.723383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.724239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:42.725380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.725740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.726172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] PATH_INFO: `/v3/users/d84847b66478498f888b8fde2c8e882a` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.728419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84847b66478498f888b8fde2c8e882a)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:42.729419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:42.735689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcda9ce-9c86-4452-ba67-e6163c8a81d1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:42.742410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:42.743133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.743524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.743701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.744359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:42.752250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:42.810392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 967/1928] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:42 2021] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:42.812004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.838135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84847b66478498f888b8fde2c8e882a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.840065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84847b66478498f888b8fde2c8e882a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.857016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84847b66478498f888b8fde2c8e882a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.869202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84847b66478498f888b8fde2c8e882a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.870044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84847b66478498f888b8fde2c8e882a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:42.893827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 962/1929] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:42 2021] DELETE /identity/v3/users/d84847b66478498f888b8fde2c8e882a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:42.904062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2456-9f54-4ddd-a50b-869f17fedd59 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:42.962116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:42.963580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:42.981190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:42.982056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:42.982339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:42.983222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:42.983927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:42.986681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.014967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 968/1930] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:42 2021] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:43.019246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.022583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:43.038332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc0a8-c5ee-43e2-8c31-a5c288286ffc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.044629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.046073 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.046859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.047373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.048500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.051808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.067181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 969/1931] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:43.070950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79146152-a52b-4167-954c-2f54d74c1d64 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.071297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.081564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.083541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.084226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67006eb-c01c-450b-afc1-de7f9938cdea admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.084509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.085307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] PATH_INFO: `/v3/users/ab5f4d9229e04c21a3bfdfad14a5d7e5` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.087474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5f4d9229e04c21a3bfdfad14a5d7e5)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.090395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.090968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.091539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.092008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.092493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.094460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.097302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.110398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 970/1932] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:43.114929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.126041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbf0da-6c80-4752-a904-2cfbcef92ed0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.133189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099c9f-d944-4c48-9157-9d57b6836788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.134477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099c9f-d944-4c48-9157-9d57b6836788 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.134477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099c9f-d944-4c48-9157-9d57b6836788 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.134775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099c9f-d944-4c48-9157-9d57b6836788 admin admin] PATH_INFO: `/v3/projects/7ef75c99e94242f4872915d6c654997d/users/32181fcbb99f44a2977818d00229b90c/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.157353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96099c9f-d944-4c48-9157-9d57b6836788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef75c99e94242f4872915d6c654997d, user_id=32181fcbb99f44a2977818d00229b90c, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.161481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96099c9f-d944-4c48-9157-9d57b6836788 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.173012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5f4d9229e04c21a3bfdfad14a5d7e5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.173719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5f4d9229e04c21a3bfdfad14a5d7e5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.180340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 971/1933] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:43 2021] PUT /identity/v3/projects/7ef75c99e94242f4872915d6c654997d/users/32181fcbb99f44a2977818d00229b90c/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:43.187813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5f4d9229e04c21a3bfdfad14a5d7e5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.191551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.191865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.192149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.196941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5f4d9229e04c21a3bfdfad14a5d7e5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.197696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-48a5f10a-ef30-41d7-928f-6912a4280448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5f4d9229e04c21a3bfdfad14a5d7e5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.219988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] MFA Rules not processed for user `32181fcbb99f44a2977818d00229b90c`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:43.221325 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:43.222540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 963/1934] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:42 2021] DELETE /identity/v3/users/ab5f4d9229e04c21a3bfdfad14a5d7e5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:43.227619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.228440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.228799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.254106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:43.256768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:43.304557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 972/1935] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:43 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:43.327650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.331982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:43.350026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 964/1936] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:43.368818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.370264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:43.447198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b3c8-9326-4927-9d9c-227364143688 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.454012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.454679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.454983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.455261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.475026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f0aba-3104-49e7-9d2f-3538e2c50231 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.475438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.476907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.479844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.481057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.481544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.482024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.493546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.495330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.501965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 973/1937] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:43 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:43.511360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 965/1938] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:43.583275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.585033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:43.610482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210def31-a3ff-41cd-bb6b-21e8433156d9 service glance] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:43.622144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:43.623164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:43.623550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:43.623929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] PATH_INFO: `/v3/projects/7d2b027a1a844940816c59a8378a4a33` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:43.625505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2b027a1a844940816c59a8378a4a33)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:43.631549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:43.754449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2b027a1a844940816c59a8378a4a33', 'request_id': 'req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.762134 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2b027a1a844940816c59a8378a4a33', 'request_id': 'req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.781104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2b027a1a844940816c59a8378a4a33', 'request_id': 'req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.814975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] The token cache is being invalidate because project 7d2b027a1a844940816c59a8378a4a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:43.816262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.817313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:43.827882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 974/1939] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:43 2021] DELETE /identity/v3/projects/7d2b027a1a844940816c59a8378a4a33 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:43.832076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:43.843747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad66d9-c915-4d52-b5c5-2bd19ad13a48 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.013502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.015063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.015930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.016422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] PATH_INFO: `/v3/users/34a2eda0b7a644afb2959e2973941398` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.018671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a2eda0b7a644afb2959e2973941398)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.021491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.107384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a2eda0b7a644afb2959e2973941398'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.108265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a2eda0b7a644afb2959e2973941398'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.120713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a2eda0b7a644afb2959e2973941398'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.135459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a2eda0b7a644afb2959e2973941398'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.136277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-14ee515c-d578-4271-a216-23fae544c5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a2eda0b7a644afb2959e2973941398'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.168324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.171004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.193885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145370b-5fff-4ae3-86f4-0ca5f69f2d07 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.194125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 966/1940] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:43 2021] DELETE /identity/v3/users/34a2eda0b7a644afb2959e2973941398 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:44.334454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.337352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.339505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.340151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] PATH_INFO: `/v3/projects/d3ee953307754e2aba210e4cae85d6ea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.341729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ee953307754e2aba210e4cae85d6ea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.344867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.424530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ee953307754e2aba210e4cae85d6ea', 'request_id': 'req-6756363d-99b5-4455-9604-5a28164207f5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.455777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ee953307754e2aba210e4cae85d6ea', 'request_id': 'req-6756363d-99b5-4455-9604-5a28164207f5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.465352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ee953307754e2aba210e4cae85d6ea', 'request_id': 'req-6756363d-99b5-4455-9604-5a28164207f5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.477616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] The token cache is being invalidate because project d3ee953307754e2aba210e4cae85d6ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:44.477903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.478558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6756363d-99b5-4455-9604-5a28164207f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.480148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 975/1941] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:44 2021] DELETE /identity/v3/projects/d3ee953307754e2aba210e4cae85d6ea => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:44.485808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.486311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.486599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.510268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:44.511588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.589817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 967/1942] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:44.591589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.592014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.592291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.606043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.607635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.619481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:44.622377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.624456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d123f-2b17-4472-b805-ca8b3720173c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.630384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.631321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.631605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.631882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] PATH_INFO: `/v3/projects/751a448285ad4a9cb6417235dcddcb9a` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.633297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751a448285ad4a9cb6417235dcddcb9a)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.637449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.638179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 976/1943] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:44.639269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.653428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efea34-cb3b-4f29-ae9b-390969c50451 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.659766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.662261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.662713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.663180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.664247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:44.664716 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.666542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.681698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 977/1944] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:44.686601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.694673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751a448285ad4a9cb6417235dcddcb9a', 'request_id': 'req-8b1e7930-ef1e-41ea-8978-2422def5a476'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.700893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751a448285ad4a9cb6417235dcddcb9a', 'request_id': 'req-8b1e7930-ef1e-41ea-8978-2422def5a476'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.703345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ce8c-8026-469b-8b77-5441e941fdec admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.710091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751a448285ad4a9cb6417235dcddcb9a', 'request_id': 'req-8b1e7930-ef1e-41ea-8978-2422def5a476'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.722691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] The token cache is being invalidate because project 751a448285ad4a9cb6417235dcddcb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:44.723760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.724787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b1e7930-ef1e-41ea-8978-2422def5a476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:44.726333 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 968/1945] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:44 2021] DELETE /identity/v3/projects/751a448285ad4a9cb6417235dcddcb9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:44.735930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4ea93-40b2-416e-b7db-95f329b52674 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.736220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4ea93-40b2-416e-b7db-95f329b52674 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.736499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4ea93-40b2-416e-b7db-95f329b52674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.755634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ece4ea93-40b2-416e-b7db-95f329b52674 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:44.756848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ece4ea93-40b2-416e-b7db-95f329b52674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.777632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.778455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.778790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.779106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.779802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.782613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.825688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 978/1946] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:44 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:44.833504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.835424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.851227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 969/1947] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:44.855614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.855985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.856347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.884268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:44.885650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:44.923863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418377f-5d9e-47de-9e3d-13f7b969b47c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.929207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.930022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.930322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.930661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.931468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.933459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.958660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 979/1948] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:44 2021] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:44.968504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.975974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 970/1949] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:44.980011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daf4cb-e970-486a-a27b-b228a472bd10 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.980278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:44.986615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.987871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:44.987871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:44.988232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:44.989058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:44.990898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:44.991374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a230010-f6a5-4818-86cb-9e7a9766a87e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:44.998783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:44.999766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.000206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.000661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.001541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:45.001831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.003755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.005602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 980/1950] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:44 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:45.009414 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.020634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 971/1951] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:41:45.024082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17b01b-7130-4dab-8402-875d02abf191 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.025508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.025854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.026516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.026794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.027100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.027819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.029404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.039836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f2ba6-a49b-4e49-bdf2-594608348a35 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.043520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 981/1952] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:45.047904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.049390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.050194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.050547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.051933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.052719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.054770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.061231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9a9ea-6958-47d1-a8f9-b14da2631358 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.067027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4598e96-ec3a-47cc-a257-f0c5fe7f2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.067918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4598e96-ec3a-47cc-a257-f0c5fe7f2b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.068197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4598e96-ec3a-47cc-a257-f0c5fe7f2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.068463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4598e96-ec3a-47cc-a257-f0c5fe7f2b22 admin admin] PATH_INFO: `/v3/projects/e3f4adcfcaff473c81a4ba75e236035e/users/947339dfaadf40179623b4d8f07b1415/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.083913 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4598e96-ec3a-47cc-a257-f0c5fe7f2b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f4adcfcaff473c81a4ba75e236035e, user_id=947339dfaadf40179623b4d8f07b1415, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.084886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 972/1953] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:45 2021] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:45.088273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4598e96-ec3a-47cc-a257-f0c5fe7f2b22 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.094081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.107015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 982/1954] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:45 2021] PUT /identity/v3/projects/e3f4adcfcaff473c81a4ba75e236035e/users/947339dfaadf40179623b4d8f07b1415/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:45.115507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.115891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.116141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.134037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:45.135256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:45.174066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca886-5a13-4e47-94f6-e58ecd85acc0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.208274 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 983/1955] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:45.218643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.221197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:45.250568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.250858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.251184 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.251463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.252149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.255187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.275426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 973/1956] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:45 2021] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:45.279435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.288294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2b1d-bb7a-4530-93cb-edf8a8b6001f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.292863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.293518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.293733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301a7b0-43f3-4a1b-9831-b3d7beaf2d34 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.293841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.294067 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.294784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.296420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.297235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.298676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.299590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.299876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.307805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 974/1957] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:45.311575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.311720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.313240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.324448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 984/1958] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:45.330609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dba3e-b41a-4a3a-9a7d-01c10d0aff14 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.336638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01e929-072b-4cea-b37d-6a8588675407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.337517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01e929-072b-4cea-b37d-6a8588675407 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.337900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01e929-072b-4cea-b37d-6a8588675407 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.338273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01e929-072b-4cea-b37d-6a8588675407 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.339267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01e929-072b-4cea-b37d-6a8588675407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.340857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01e929-072b-4cea-b37d-6a8588675407 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.353354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 975/1959] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:45 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:45.357574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.368582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9670f6-f58a-4d34-8bdc-34f69b6542d2 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.374483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.375398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.375682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.375958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] PATH_INFO: `/v3/projects/73e21965d64f4ef5abfd4a487b71d87f/users/2498ddd0abae43ebab7aa33634ca8690/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.392100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e21965d64f4ef5abfd4a487b71d87f, user_id=2498ddd0abae43ebab7aa33634ca8690, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.395541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.409957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 985/1960] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:45 2021] PUT /identity/v3/projects/73e21965d64f4ef5abfd4a487b71d87f/users/2498ddd0abae43ebab7aa33634ca8690/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:45.422089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.422387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.422672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.452683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] MFA Rules not processed for user `2498ddd0abae43ebab7aa33634ca8690`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:45.454090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:45.533507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 976/1961] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:45 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:45.549782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.552794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:45.639436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf229c8-76b6-4c24-a388-6cc27ba63740 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.647320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321d8d2-dea7-47e4-ba33-45fc45b49c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.647846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321d8d2-dea7-47e4-ba33-45fc45b49c74 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.648120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321d8d2-dea7-47e4-ba33-45fc45b49c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.648397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321d8d2-dea7-47e4-ba33-45fc45b49c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.658554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321d8d2-dea7-47e4-ba33-45fc45b49c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.661005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321d8d2-dea7-47e4-ba33-45fc45b49c74 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.677213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 986/1962] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:45 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:45.718194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:45.807111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8713e9-11f6-486a-ae8c-8465dfa324d9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:45.811364 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:45.812821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.812821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.813212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] PATH_INFO: `/v3/users/2498ddd0abae43ebab7aa33634ca8690` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.814556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2498ddd0abae43ebab7aa33634ca8690)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:45.817411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:45.870724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2498ddd0abae43ebab7aa33634ca8690'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:45.871528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2498ddd0abae43ebab7aa33634ca8690'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:45.879662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2498ddd0abae43ebab7aa33634ca8690'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:45.892746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2498ddd0abae43ebab7aa33634ca8690'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:45.893380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d4f8c28b-d140-429a-bfd6-4672463dd3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2498ddd0abae43ebab7aa33634ca8690'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:45.911975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 977/1963] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:45 2021] DELETE /identity/v3/users/2498ddd0abae43ebab7aa33634ca8690 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:45.916491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:45.916780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:45.917060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:45.935042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:45.936222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.002962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 987/1964] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:46.011341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:46.012084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.012580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.012900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.013193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.044965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] MFA Rules not processed for user `947339dfaadf40179623b4d8f07b1415`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:46.046440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.078292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9f15b-712a-4555-b950-be3dde3f123b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:46.081880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:46.083156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.083964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.083964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.092812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:46.094269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:46.104761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 988/1965] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:46.120912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 978/1966] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:46 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:46.133017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:46.134873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.204742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bea78-76b0-4ef7-aca7-e3fa15d2d520 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:46.209929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050eed9-fe34-4652-aee2-cb4e00632d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:46.210810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050eed9-fe34-4652-aee2-cb4e00632d1c service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.211314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050eed9-fe34-4652-aee2-cb4e00632d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.212035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050eed9-fe34-4652-aee2-cb4e00632d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.225927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050eed9-fe34-4652-aee2-cb4e00632d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:46.229071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050eed9-fe34-4652-aee2-cb4e00632d1c service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:46.255524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 989/1967] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:46.602254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:46.604062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.631794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655715b-1f5b-479f-8640-b31905848f5b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:46.638900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:46.639807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.640087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.640453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] PATH_INFO: `/v3/projects/73e21965d64f4ef5abfd4a487b71d87f` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.641527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e21965d64f4ef5abfd4a487b71d87f)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:46.643525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:46.690094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e21965d64f4ef5abfd4a487b71d87f', 'request_id': 'req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:46.696137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e21965d64f4ef5abfd4a487b71d87f', 'request_id': 'req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:46.703762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e21965d64f4ef5abfd4a487b71d87f', 'request_id': 'req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:46.715265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] The token cache is being invalidate because project 73e21965d64f4ef5abfd4a487b71d87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:46.715548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:46.716172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-30cd31d3-866e-4f0b-9d2c-e7d713f9514a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:46.717684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 979/1968] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:46 2021] DELETE /identity/v3/projects/73e21965d64f4ef5abfd4a487b71d87f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:46.723464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.724062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.724062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.740904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:46.742027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.799077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 990/1969] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:46.807807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.808089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.808432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.826833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:46.828036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:46.836314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 980/1970] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:46.840848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:46.853187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7a95d-d963-4b1b-aa62-c1d5aaa42f03 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:46.858736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:46.859445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.859733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.860014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.860748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:46.861104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:46.862709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:46.875520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 991/1971] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:46.881524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:46.890591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c534d05-6714-4e13-bc33-04e8ecb849b8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:46.896331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:46.896997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.897300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.897565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.898256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:46.900206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:46.925308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 981/1972] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:46 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:46.929684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:46.938840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6272-1e4c-4dc1-8160-35721932faf9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:46.993509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:46.994170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:46.994455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:46.994730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:46.995453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:46.997345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:47.016642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 992/1973] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:46 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:47.021772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:47.031465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3d1c-e4ba-4dce-9262-f9fdc0211c54 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:47.036724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:47.037383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:47.037669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:47.037948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:47.038670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:47.040321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:47.050773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 982/1974] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:47.055180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:47.064391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad4d87-7415-4cff-a3fa-46437c052fb0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:47.069049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1b618-b3a8-4940-ae1e-6cddc4ce59b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:47.069701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b618-b3a8-4940-ae1e-6cddc4ce59b1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:47.069986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b618-b3a8-4940-ae1e-6cddc4ce59b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:47.070262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b618-b3a8-4940-ae1e-6cddc4ce59b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:47.071015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1b618-b3a8-4940-ae1e-6cddc4ce59b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:47.072603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1b618-b3a8-4940-ae1e-6cddc4ce59b1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:47.082813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 993/1975] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:47.087052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:47.096130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4aaee-5855-470a-af0f-79cdc0170c86 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:47.101148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:47.102020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:47.102302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:47.102576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] PATH_INFO: `/v3/projects/e68bd061e90443899994b6f855aa27fa/users/a99a78a99f7d48e4b48f221a71dcd2e6/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:47.119161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68bd061e90443899994b6f855aa27fa, user_id=a99a78a99f7d48e4b48f221a71dcd2e6, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:47.121836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:47.134353 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 983/1976] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:47 2021] PUT /identity/v3/projects/e68bd061e90443899994b6f855aa27fa/users/a99a78a99f7d48e4b48f221a71dcd2e6/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:47.145256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f046-eac7-4974-8739-b1c467a67582 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:47.145914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f046-eac7-4974-8739-b1c467a67582 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:47.146194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f046-eac7-4974-8739-b1c467a67582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:47.172981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c8b6f046-eac7-4974-8739-b1c467a67582 None None] MFA Rules not processed for user `a99a78a99f7d48e4b48f221a71dcd2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:47.174145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c8b6f046-eac7-4974-8739-b1c467a67582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:47.245678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 994/1977] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:47 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:47.256178 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:47.257917 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:47.313232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764eba2-8d88-44e0-acc1-dfb62372886b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:47.317295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d586f-7101-463a-8fcb-ebef7353a6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:47.317942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d586f-7101-463a-8fcb-ebef7353a6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:47.318281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d586f-7101-463a-8fcb-ebef7353a6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:47.318548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d586f-7101-463a-8fcb-ebef7353a6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:47.326756 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d586f-7101-463a-8fcb-ebef7353a6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:47.328249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d586f-7101-463a-8fcb-ebef7353a6c9 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:47.337532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 984/1978] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:47 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:41:49.760093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:49.760613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:49.760754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:49.778363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] MFA Rules not processed for user `a99a78a99f7d48e4b48f221a71dcd2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:49.779564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:49.785874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 995/1979] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:49 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:41:49.833912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12c97-6dac-4d8b-a9f1-fb4fef7feac7 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:49.834407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12c97-6dac-4d8b-a9f1-fb4fef7feac7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:49.834507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12c97-6dac-4d8b-a9f1-fb4fef7feac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:49.851598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-35f12c97-6dac-4d8b-a9f1-fb4fef7feac7 None None] MFA Rules not processed for user `947339dfaadf40179623b4d8f07b1415`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:49.852724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-35f12c97-6dac-4d8b-a9f1-fb4fef7feac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:49.908407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 985/1980] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:49 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:53.062384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:53.066101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:53.201940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8de95-ff60-4c71-8a4c-8e4adec98721 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:53.206479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:53.207493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:53.207844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:53.208339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] PATH_INFO: `/v3/users/07f2075dbc984612aa74bdd637a3bf5d` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:53.211127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f2075dbc984612aa74bdd637a3bf5d)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:53.213355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:53.293546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f2075dbc984612aa74bdd637a3bf5d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:53.304980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f2075dbc984612aa74bdd637a3bf5d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:53.306129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f2075dbc984612aa74bdd637a3bf5d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:53.322205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f2075dbc984612aa74bdd637a3bf5d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:53.336576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f2075dbc984612aa74bdd637a3bf5d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:53.346980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 996/1981] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:53 2021] DELETE /identity/v3/users/07f2075dbc984612aa74bdd637a3bf5d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:53.353011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:53.353545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:53.353545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:53.390328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:53.392274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:53.520527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 986/1982] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:53.531263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:53.532722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:53.600875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897cf83-43b5-45c5-8fc4-d4c49d4f226b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:53.606475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:53.607088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:53.607718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:53.607718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:53.625486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:53.627030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:53.638642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 997/1983] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:54.135413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:54.136806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:54.149458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5b586-09d9-48d1-85ce-17d91cbc8b0a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:54.165372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:54.166271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:54.167303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:54.171496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] PATH_INFO: `/v3/projects/8eb011670edb4fe28045ad41de9e0949` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:54.173058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb011670edb4fe28045ad41de9e0949)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:54.175331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:54.234197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb011670edb4fe28045ad41de9e0949', 'request_id': 'req-bfb2e067-7c06-48f8-98e5-985ddf79deff'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.240868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb011670edb4fe28045ad41de9e0949', 'request_id': 'req-bfb2e067-7c06-48f8-98e5-985ddf79deff'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.257373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb011670edb4fe28045ad41de9e0949', 'request_id': 'req-bfb2e067-7c06-48f8-98e5-985ddf79deff'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.272451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] The token cache is being invalidate because project 8eb011670edb4fe28045ad41de9e0949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:54.272776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.273639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.275326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 987/1984] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:54 2021] DELETE /identity/v3/projects/8eb011670edb4fe28045ad41de9e0949 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:54.279560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:54.289530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbcb32-e5e6-45b0-9c18-85f8df3b1f3c service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:54.355463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:54.356628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:54.357070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:54.357499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] PATH_INFO: `/v3/users/bdc45d74905c441e8d1fbf1953ea813d` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:54.358843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc45d74905c441e8d1fbf1953ea813d)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:54.360827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:54.444772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc45d74905c441e8d1fbf1953ea813d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.460566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc45d74905c441e8d1fbf1953ea813d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.461320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc45d74905c441e8d1fbf1953ea813d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.475395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc45d74905c441e8d1fbf1953ea813d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.484215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1675b50-a28d-4a21-a662-91fa80416d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc45d74905c441e8d1fbf1953ea813d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:54.491560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 998/1985] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:54 2021] DELETE /identity/v3/users/bdc45d74905c441e8d1fbf1953ea813d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:54.928679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:54.930463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:54.964456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2e067-7c06-48f8-98e5-985ddf79deff admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.047175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.048458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.048944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.049489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] PATH_INFO: `/v3/projects/f1512985412a4145ad2c7717a6492ca4` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.050879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1512985412a4145ad2c7717a6492ca4)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.053630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.111869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1512985412a4145ad2c7717a6492ca4', 'request_id': 'req-03e614cb-8a26-40b5-9a4e-4ed62754644b'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:55.121851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1512985412a4145ad2c7717a6492ca4', 'request_id': 'req-03e614cb-8a26-40b5-9a4e-4ed62754644b'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:55.134304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1512985412a4145ad2c7717a6492ca4', 'request_id': 'req-03e614cb-8a26-40b5-9a4e-4ed62754644b'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:55.159142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] The token cache is being invalidate because project f1512985412a4145ad2c7717a6492ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:55.159449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:55.160229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-03e614cb-8a26-40b5-9a4e-4ed62754644b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:55.166956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 988/1986] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:54 2021] DELETE /identity/v3/projects/f1512985412a4145ad2c7717a6492ca4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:55.170369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.170724 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.171088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.192440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:55.194227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:55.281469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 999/1987] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:55.289148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.289537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.289892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.309019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:55.310299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:55.322547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 989/1988] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:55.323955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.335338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eab85-8b1d-41bc-86b0-c763e71ae6dd None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.340285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131e215-3299-4162-85b1-59817411202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.340959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131e215-3299-4162-85b1-59817411202b admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.341249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131e215-3299-4162-85b1-59817411202b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.341527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131e215-3299-4162-85b1-59817411202b admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.342261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131e215-3299-4162-85b1-59817411202b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:55.342639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131e215-3299-4162-85b1-59817411202b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.344388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131e215-3299-4162-85b1-59817411202b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.357139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1000/1989] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:55.361460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.371211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ce612-aa37-4876-b807-12761c175cc9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.379440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.380752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.381101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.381285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.381972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.383954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.416817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 990/1990] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:55.420858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131e215-3299-4162-85b1-59817411202b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.440658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131e215-3299-4162-85b1-59817411202b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.551519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.553130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.553497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.553885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.555003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.557060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.591512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1001/1991] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:41:55.595396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.607644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4d8ae-4864-48e6-a55c-bd72d0a677b3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.612483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.613168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.613450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.613722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.614503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.616171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.627695 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 991/1992] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:55.632579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.645539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6170a6-6a43-4f84-9686-1f8f7a052f13 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.650818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91765915-9b82-4063-874f-107aea0bd0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.651704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765915-9b82-4063-874f-107aea0bd0fe admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.652117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765915-9b82-4063-874f-107aea0bd0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.652428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765915-9b82-4063-874f-107aea0bd0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.653317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765915-9b82-4063-874f-107aea0bd0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.655190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765915-9b82-4063-874f-107aea0bd0fe admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.668176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1002/1993] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:55.671465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.680665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf311f5-ccc6-4388-8868-f6dd1a9c4e39 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.685156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.686139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.686493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.686835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] PATH_INFO: `/v3/projects/85c73c3e8c0d4f8a8e8ff703ea240a53/users/c70cf51d0d7a4689bec54e000461b11a/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.704230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c73c3e8c0d4f8a8e8ff703ea240a53, user_id=c70cf51d0d7a4689bec54e000461b11a, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.707401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.724536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 992/1994] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:55 2021] PUT /identity/v3/projects/85c73c3e8c0d4f8a8e8ff703ea240a53/users/c70cf51d0d7a4689bec54e000461b11a/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:55.736074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.736573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.737270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.770254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] MFA Rules not processed for user `c70cf51d0d7a4689bec54e000461b11a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:55.772141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:55.839692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1003/1995] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:55.845463 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.928690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2210f6-8e5a-4f4c-81ea-eab0edcb9143 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:55.947167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:55.947850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:55.948132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:55.948405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:55.949096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:55.951297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:55.982967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 993/1996] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:55.986017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:55.996179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c798cb5-0e9a-4b9b-b1ce-168b74f005d9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:56.065550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:56.066478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.066817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.069218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.070132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:56.072108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:56.114274 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1004/1997] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:55 2021] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:56.116246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:56.131377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a365b1-9959-4f93-8f25-1f8fee9a52d7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:56.167115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:56.168052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.168589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.169071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.170077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:56.171946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:56.194796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 994/1998] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:56 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:56.196029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:56.209471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ba44-e51d-4be0-8e42-f41988992583 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:56.217100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:56.218765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.219309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.219789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] PATH_INFO: `/v3/projects/ab2f3fb531764a1683c1d9182543654c/users/d2d14ffe5f8442c68728299c9af116fe/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.241939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2f3fb531764a1683c1d9182543654c, user_id=d2d14ffe5f8442c68728299c9af116fe, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:56.246230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:56.268725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1005/1999] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:56 2021] PUT /identity/v3/projects/ab2f3fb531764a1683c1d9182543654c/users/d2d14ffe5f8442c68728299c9af116fe/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:56.274353 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:56.293378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa8b89-130a-4cc6-b998-3ff02c29011c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:56.360778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee5fd-57bf-4daa-bb64-cf506e4d3dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:56.361454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee5fd-57bf-4daa-bb64-cf506e4d3dac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.361738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee5fd-57bf-4daa-bb64-cf506e4d3dac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.362015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee5fd-57bf-4daa-bb64-cf506e4d3dac admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.362743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee5fd-57bf-4daa-bb64-cf506e4d3dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:56.364647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee5fd-57bf-4daa-bb64-cf506e4d3dac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:56.378746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 995/2000] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:56 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:56.379891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:56.396474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe3b2-4169-49f8-8b18-5de99c03ec0c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:56.402283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:56.403167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.403693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.403978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] PATH_INFO: `/v3/projects/ab2f3fb531764a1683c1d9182543654c/users/d2d14ffe5f8442c68728299c9af116fe/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.405918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2f3fb531764a1683c1d9182543654c, user_id=d2d14ffe5f8442c68728299c9af116fe, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:56.410313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:56.434102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1006/2001] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:56 2021] PUT /identity/v3/projects/ab2f3fb531764a1683c1d9182543654c/users/d2d14ffe5f8442c68728299c9af116fe/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:56.443846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3d0e6-0482-4394-9b85-b39c1b5246a9 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.444053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3d0e6-0482-4394-9b85-b39c1b5246a9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.444995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3d0e6-0482-4394-9b85-b39c1b5246a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.478647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b2b3d0e6-0482-4394-9b85-b39c1b5246a9 None None] MFA Rules not processed for user `d2d14ffe5f8442c68728299c9af116fe`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:56.480510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b2b3d0e6-0482-4394-9b85-b39c1b5246a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:56.702761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 996/2002] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:56 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:56.708566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:56.774430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3b3a-d510-492e-94ad-c76faf2ac248 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:56.779377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:56.780235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.780553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.780900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] PATH_INFO: `/v3/users/c70cf51d0d7a4689bec54e000461b11a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.782080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70cf51d0d7a4689bec54e000461b11a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:56.784055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:56.837287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70cf51d0d7a4689bec54e000461b11a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:56.844964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70cf51d0d7a4689bec54e000461b11a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:56.845748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70cf51d0d7a4689bec54e000461b11a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:56.860867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70cf51d0d7a4689bec54e000461b11a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:56.871927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70cf51d0d7a4689bec54e000461b11a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:56.885155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1007/2003] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:56 2021] DELETE /identity/v3/users/c70cf51d0d7a4689bec54e000461b11a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:56.889715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:56.890009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:56.890316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:56.926272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:56.927745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:57.048950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 997/2004] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:57.080835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:57.082153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:57.187770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e38c7-724e-4bc3-aa3f-8bd5c6febb58 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:57.192931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3812f1-204f-44ea-965b-1c05a65cee3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:57.193566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3812f1-204f-44ea-965b-1c05a65cee3f service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:57.193846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3812f1-204f-44ea-965b-1c05a65cee3f service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:57.194117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3812f1-204f-44ea-965b-1c05a65cee3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:57.205219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3812f1-204f-44ea-965b-1c05a65cee3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:57.207477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3812f1-204f-44ea-965b-1c05a65cee3f service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:57.220749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1008/2005] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:41:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:41:58.027458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:58.031004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:58.072780 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed50be-58c7-40c1-b2f4-f7c9ebfd203c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:58.079745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:58.081000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:58.081283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:58.081721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] PATH_INFO: `/v3/projects/85c73c3e8c0d4f8a8e8ff703ea240a53` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:58.084206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c73c3e8c0d4f8a8e8ff703ea240a53)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:58.086116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:58.124168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:58.124725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:58.124838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:58.143473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] MFA Rules not processed for user `b84cbe113bf545c19654aed0a6049694`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:58.143776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c73c3e8c0d4f8a8e8ff703ea240a53', 'request_id': 'req-12dadccc-d6a3-496c-a1be-9e6b1b52624e'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.144764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:58.150185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c73c3e8c0d4f8a8e8ff703ea240a53', 'request_id': 'req-12dadccc-d6a3-496c-a1be-9e6b1b52624e'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.159065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c73c3e8c0d4f8a8e8ff703ea240a53', 'request_id': 'req-12dadccc-d6a3-496c-a1be-9e6b1b52624e'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.176660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] The token cache is being invalidate because project 85c73c3e8c0d4f8a8e8ff703ea240a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:58.177161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.178081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.179821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 998/2006] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:58 2021] DELETE /identity/v3/projects/85c73c3e8c0d4f8a8e8ff703ea240a53 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:58.183689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:58.185287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:58.213151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1009/2007] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:58 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:58.271206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dadccc-d6a3-496c-a1be-9e6b1b52624e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:58.275985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:58.281428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:58.281723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:58.282007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] PATH_INFO: `/v3/users/d2d14ffe5f8442c68728299c9af116fe` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:58.283311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d14ffe5f8442c68728299c9af116fe)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:58.290483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:58.357186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d14ffe5f8442c68728299c9af116fe'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.357874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d14ffe5f8442c68728299c9af116fe'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.371943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d14ffe5f8442c68728299c9af116fe'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.382212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d14ffe5f8442c68728299c9af116fe'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.382957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-315f2207-3162-440b-a9fe-98f6efca9ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d14ffe5f8442c68728299c9af116fe'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:58.407699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 999/2008] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:41:58 2021] DELETE /identity/v3/users/d2d14ffe5f8442c68728299c9af116fe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:41:58.899042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:58.918958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a24f-97f4-42e5-94d3-b1ef766a3674 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.033289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.034171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.034973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.034973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] PATH_INFO: `/v3/projects/ab2f3fb531764a1683c1d9182543654c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.038244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2f3fb531764a1683c1d9182543654c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.040424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.138112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2f3fb531764a1683c1d9182543654c', 'request_id': 'req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:59.143968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2f3fb531764a1683c1d9182543654c', 'request_id': 'req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:59.153817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2f3fb531764a1683c1d9182543654c', 'request_id': 'req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:59.171135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] The token cache is being invalidate because project ab2f3fb531764a1683c1d9182543654c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:41:59.171529 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:59.172279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1dc7f42b-46cf-4f2d-8caf-2215cd28a6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:41:59.174198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1010/2009] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:41:58 2021] DELETE /identity/v3/projects/ab2f3fb531764a1683c1d9182543654c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:59.180275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.180835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.180835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.201526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:59.203149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:59.296253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1000/2010] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:59.305662 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.306159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.306581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.329304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:59.330510 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:59.341046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1011/2011] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:59.345259 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:59.358677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bc1e5-9071-46d9-a0b6-28846a4f1e2f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.370146 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.371198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.371865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.372331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.374204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:41:59.374748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.376707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.393833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1001/2012] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:41:59.398284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:59.410984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d81fe-e0f4-4dbb-a0fc-1b055b50fe9a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.416524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.417378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.417675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.417953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.418657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.420820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.458955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1012/2013] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:59 2021] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:59.461831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:59.480566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc78a-8542-4dc6-9d44-4e522bd7cb08 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.551689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.553005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.553289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.553564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.554365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.556376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.580948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1002/2014] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:41:59 2021] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:41:59.588137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:59.601091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57627313-3b4b-41e5-980c-b4daf3ef0d8f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.605851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.606553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.606839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.607145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.607878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.609495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.623017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1013/2015] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:59 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:41:59.631247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:59.641462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507918c-10ac-4ab0-b9a4-c421e6f56e66 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.647148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1072e-e46c-40a1-8202-715fb7ba3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.648309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1072e-e46c-40a1-8202-715fb7ba3e59 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.648642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1072e-e46c-40a1-8202-715fb7ba3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.649077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1072e-e46c-40a1-8202-715fb7ba3e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.650043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1072e-e46c-40a1-8202-715fb7ba3e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.652499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1072e-e46c-40a1-8202-715fb7ba3e59 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.667322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1003/2016] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:41:59 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:41:59.671563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:41:59.681784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c1fe-48c1-42c8-be5f-9e61f3c65fb3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:41:59.686301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:41:59.687209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.687492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.687765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] PATH_INFO: `/v3/projects/d53bd052685f416180c719e6ce145bf0/users/05bc20d305a4493492cb92c102ae4bd7/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.713675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53bd052685f416180c719e6ce145bf0, user_id=05bc20d305a4493492cb92c102ae4bd7, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:41:59.716557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:41:59.735843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1014/2017] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:41:59 2021] PUT /identity/v3/projects/d53bd052685f416180c719e6ce145bf0/users/05bc20d305a4493492cb92c102ae4bd7/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:41:59.748709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:41:59.751929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:41:59.752610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:41:59.812717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] MFA Rules not processed for user `05bc20d305a4493492cb92c102ae4bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:41:59.814257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:41:59.922425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1004/2018] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:41:59 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:41:59.927051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.014372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d945f-70f1-40af-a265-50dfc7fa05f7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.022952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.022952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.022952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.022952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.023439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.023696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.060567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1015/2019] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:41:59 2021] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:00.064206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.076603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc014958-581a-4a28-b465-6b1675ec9e31 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.204504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.205203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.205490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.205767 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.206486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.209091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.237047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1005/2020] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:00 2021] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:00.248576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.261151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127e6b-56c0-4560-a3b6-330c7109153b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.276047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.276737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.277021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.277296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.279728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.281394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.306987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1016/2021] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:00.308517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.324700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50eb37-2509-4413-9a6a-b8941ba1a603 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.338371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.339535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.339983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.340405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] PATH_INFO: `/v3/projects/5f534131d6b94aad85193eed31f63740/users/10311bb5e8ba4c4ab92e357b38798460/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.381265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f534131d6b94aad85193eed31f63740, user_id=10311bb5e8ba4c4ab92e357b38798460, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.384262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.404496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1006/2022] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:00 2021] PUT /identity/v3/projects/5f534131d6b94aad85193eed31f63740/users/10311bb5e8ba4c4ab92e357b38798460/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:00.408731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.420978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e6c3-8dd4-49ff-9450-dcf79ad1089f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.525485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ade879-ccf2-45e4-b0a9-4c2927b69d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.525485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ade879-ccf2-45e4-b0a9-4c2927b69d26 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.525485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ade879-ccf2-45e4-b0a9-4c2927b69d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.526407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ade879-ccf2-45e4-b0a9-4c2927b69d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.528235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ade879-ccf2-45e4-b0a9-4c2927b69d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.537351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ade879-ccf2-45e4-b0a9-4c2927b69d26 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.552795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1017/2023] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:00 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:00.553946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.569037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c473f-cec5-4ea0-8c48-11a6abbc4d26 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.587876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.591704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.592670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.599836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] PATH_INFO: `/v3/projects/5f534131d6b94aad85193eed31f63740/users/10311bb5e8ba4c4ab92e357b38798460/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.603818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f534131d6b94aad85193eed31f63740, user_id=10311bb5e8ba4c4ab92e357b38798460, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.616217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.634900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1007/2024] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:00 2021] PUT /identity/v3/projects/5f534131d6b94aad85193eed31f63740/users/10311bb5e8ba4c4ab92e357b38798460/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:00.636790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.637501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.638043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.691697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] MFA Rules not processed for user `10311bb5e8ba4c4ab92e357b38798460`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:00.693436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:00.793451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1018/2025] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:00 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:00.800820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:00.803232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:00.895390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3092ce4-4f08-42cd-9074-fff913ffdf7b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:00.900165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd687e8-a4c5-4fd7-8084-d704a85616bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:00.901012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd687e8-a4c5-4fd7-8084-d704a85616bc service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:00.901560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd687e8-a4c5-4fd7-8084-d704a85616bc service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:00.901847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd687e8-a4c5-4fd7-8084-d704a85616bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:00.912951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd687e8-a4c5-4fd7-8084-d704a85616bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:00.914563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd687e8-a4c5-4fd7-8084-d704a85616bc service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:00.928844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1008/2026] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:00 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:42:01.027161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:01.135843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad626a7-1355-4c33-a354-ff43c721c7f9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:01.143752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:01.143752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:01.143752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:01.143752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] PATH_INFO: `/v3/users/05bc20d305a4493492cb92c102ae4bd7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:01.146275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bc20d305a4493492cb92c102ae4bd7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:01.148748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:01.205600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bc20d305a4493492cb92c102ae4bd7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.219843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bc20d305a4493492cb92c102ae4bd7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.220847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bc20d305a4493492cb92c102ae4bd7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.241731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bc20d305a4493492cb92c102ae4bd7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.253465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bc20d305a4493492cb92c102ae4bd7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.261925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1019/2027] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:01 2021] DELETE /identity/v3/users/05bc20d305a4493492cb92c102ae4bd7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:01.267087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:01.267599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:01.267706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:01.289469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:01.290672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:01.357577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1009/2028] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:01.385647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:01.387136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:01.466137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce9ce7-9e06-4bce-8e7e-442b7b13951b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:01.470063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:01.470956 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:01.471386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:01.472055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:01.484332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:01.486960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:01.501452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1020/2029] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:01.815595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:01.817036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:01.828601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14a10b-1bb7-4254-8dbc-6bff0cc003ce None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:01.833858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:01.835093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:01.835497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:01.836439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] PATH_INFO: `/v3/users/1b653c4b85d4454f958f51ce6ae0a758` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:01.837151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b653c4b85d4454f958f51ce6ae0a758)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:01.839334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:01.898360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b653c4b85d4454f958f51ce6ae0a758'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.899158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b653c4b85d4454f958f51ce6ae0a758'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.907165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b653c4b85d4454f958f51ce6ae0a758'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.921222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b653c4b85d4454f958f51ce6ae0a758'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.923425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b653c4b85d4454f958f51ce6ae0a758'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:01.945080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1010/2030] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:01 2021] DELETE /identity/v3/users/1b653c4b85d4454f958f51ce6ae0a758 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:42:02.114968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:02.116660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:02.130888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c3167-a72d-49c4-8dd5-35c4e3ec751e service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:02.233976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:02.234933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.241489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.241489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] PATH_INFO: `/v3/projects/d53bd052685f416180c719e6ce145bf0` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.241489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53bd052685f416180c719e6ce145bf0)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:02.250262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:02.312284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53bd052685f416180c719e6ce145bf0', 'request_id': 'req-f6210b4c-1b28-4e7d-a144-576f1424b112'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.320596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53bd052685f416180c719e6ce145bf0', 'request_id': 'req-f6210b4c-1b28-4e7d-a144-576f1424b112'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.330158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53bd052685f416180c719e6ce145bf0', 'request_id': 'req-f6210b4c-1b28-4e7d-a144-576f1424b112'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.345506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] The token cache is being invalidate because project d53bd052685f416180c719e6ce145bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:02.345923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.347111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.353180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1021/2031] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:02 2021] DELETE /identity/v3/projects/d53bd052685f416180c719e6ce145bf0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:02.357152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:02.358948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:02.370781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:02.373516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:02.376834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78dfe-9fe1-46ef-8cbb-be48ec2fd126 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:02.449007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:02.449909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.450195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.450492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] PATH_INFO: `/v3/users/10311bb5e8ba4c4ab92e357b38798460` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.451876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=10311bb5e8ba4c4ab92e357b38798460)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:02.454860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:02.467153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6210b4c-1b28-4e7d-a144-576f1424b112 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:02.472621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:02.474433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.474807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.475460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] PATH_INFO: `/v3/projects/53ca37f4cac34914bcdaf6596b22f20a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.480995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ca37f4cac34914bcdaf6596b22f20a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:02.483789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:02.518506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10311bb5e8ba4c4ab92e357b38798460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.519245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10311bb5e8ba4c4ab92e357b38798460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.528408 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10311bb5e8ba4c4ab92e357b38798460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.545053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10311bb5e8ba4c4ab92e357b38798460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.545796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-83aeccd7-8ec0-4612-8313-6779c8323aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10311bb5e8ba4c4ab92e357b38798460'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.553762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ca37f4cac34914bcdaf6596b22f20a', 'request_id': 'req-296a65bc-a151-4f8b-bf67-99b25ee1e234'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.569960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1011/2032] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:02 2021] DELETE /identity/v3/users/10311bb5e8ba4c4ab92e357b38798460 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:02.570151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ca37f4cac34914bcdaf6596b22f20a', 'request_id': 'req-296a65bc-a151-4f8b-bf67-99b25ee1e234'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.581794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ca37f4cac34914bcdaf6596b22f20a', 'request_id': 'req-296a65bc-a151-4f8b-bf67-99b25ee1e234'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.603136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] The token cache is being invalidate because project 53ca37f4cac34914bcdaf6596b22f20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:02.603439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.604201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-296a65bc-a151-4f8b-bf67-99b25ee1e234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:02.609954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1022/2033] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:02 2021] DELETE /identity/v3/projects/53ca37f4cac34914bcdaf6596b22f20a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:02.611749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.612158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.612548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.633959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:02.635432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:02.717036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1012/2034] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:02.727197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.727820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.728296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.761368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:02.762845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:02.772854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1023/2035] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:02.777475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:02.788060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93322ca3-5fdd-487a-8616-667324e24207 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:02.793821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:02.795035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.795520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.796013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.797276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:02.797922 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:02.800093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:02.818934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1013/2036] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:42:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:02.820629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:02.835349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140fe6-e09e-4617-b6ee-d9ecff0ac348 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:02.841063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:02.842528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:02.842813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:02.843123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:02.843832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:02.846162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:02.894162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1024/2037] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:02 2021] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:02.895101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:02.915113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa4515-b4db-41a7-92c6-ac196a6c882b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.012574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.013998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.014462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.014899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.015952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.019328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.050638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1014/2038] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:02 2021] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:03.055536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.065349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f25acc-9883-45e6-bbc7-7074a045c13c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.070068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.070731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.071343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.071343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.072118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.073725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.085175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1025/2039] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:03.089467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.108866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35af00c-7232-4d20-909c-a8a8ca99cf49 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.115076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.116119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.116485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.116848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.117882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.119852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.131473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1015/2040] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:03.135689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.144289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.148163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:03.158985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084170-4090-491d-9abb-1f6382092f18 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.168708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d82a2-39d2-4b28-a182-90395ed9ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.170523 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d82a2-39d2-4b28-a182-90395ed9ca06 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.170800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d82a2-39d2-4b28-a182-90395ed9ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.171252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d82a2-39d2-4b28-a182-90395ed9ca06 admin admin] PATH_INFO: `/v3/projects/36d15843107e4bc39513973ab3b5be96/users/f80f1abf0ffa49e29e21a2b59b12330a/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.173918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46e1a-ff74-41b3-800b-cb60804ad0a7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.180500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.181654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.182012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.182529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] PATH_INFO: `/v3/projects/5f534131d6b94aad85193eed31f63740` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.183711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f534131d6b94aad85193eed31f63740)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.186090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.189229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d82a2-39d2-4b28-a182-90395ed9ca06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d15843107e4bc39513973ab3b5be96, user_id=f80f1abf0ffa49e29e21a2b59b12330a, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.192186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d82a2-39d2-4b28-a182-90395ed9ca06 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.209960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1026/2041] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:03 2021] PUT /identity/v3/projects/36d15843107e4bc39513973ab3b5be96/users/f80f1abf0ffa49e29e21a2b59b12330a/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:03.216407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.216763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.217107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.246847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:03.248161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:03.251794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f534131d6b94aad85193eed31f63740', 'request_id': 'req-f256bd44-8860-450b-8f02-dc9fff3c6f7a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:03.258779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f534131d6b94aad85193eed31f63740', 'request_id': 'req-f256bd44-8860-450b-8f02-dc9fff3c6f7a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:03.278694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f534131d6b94aad85193eed31f63740', 'request_id': 'req-f256bd44-8860-450b-8f02-dc9fff3c6f7a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:03.307853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] The token cache is being invalidate because project 5f534131d6b94aad85193eed31f63740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:03.308141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:03.308885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f256bd44-8860-450b-8f02-dc9fff3c6f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:03.315468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1016/2042] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:03 2021] DELETE /identity/v3/projects/5f534131d6b94aad85193eed31f63740 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:03.316517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a00d3-6551-4df6-9515-58ef3465a4d3 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.316814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a00d3-6551-4df6-9515-58ef3465a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.317084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a00d3-6551-4df6-9515-58ef3465a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.338771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-628a00d3-6551-4df6-9515-58ef3465a4d3 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:03.340453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-628a00d3-6551-4df6-9515-58ef3465a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:03.343412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1027/2043] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:03.349824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1017/2044] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:03.353942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.355648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:03.358571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.359063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.359285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.406243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:03.407707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:03.429713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1018/2045] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:03.431283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.449182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98b57-be3d-4330-a944-1bed1b333ac9 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.449182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.449182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.449182 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.449552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.449552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:03.449552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.449552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.461940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d068-5cce-4cd1-8811-d6b03fbec1be None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.463793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1019/2046] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:42:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:42:03.466109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.466794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.467249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.467525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.468200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.478766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.479651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e60c08-d0b3-4292-8db4-2c9de9f97cad admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.480833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.485735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.490948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.491481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.491864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.492668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.494946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.496710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1028/2047] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:42:03.530251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1020/2048] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:03.531845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.544117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652e754-54e5-487c-8c25-a57f080e52b1 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.616736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.617466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.617846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.618296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.619154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.621818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.650357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1029/2049] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:03.652579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.665272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e0443-6bfc-4295-94a9-22633fd4b94c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.670955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.671420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.672380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.672380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.673229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.675120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.691164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1021/2050] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:03.694209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.706241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b132cd-499c-43bf-bf9c-5196d62272dc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.712743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35cba-0aa2-443c-9a23-98b0b157df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.712883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35cba-0aa2-443c-9a23-98b0b157df47 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.713225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35cba-0aa2-443c-9a23-98b0b157df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.713565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35cba-0aa2-443c-9a23-98b0b157df47 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.714559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35cba-0aa2-443c-9a23-98b0b157df47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.716455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35cba-0aa2-443c-9a23-98b0b157df47 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.730357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1030/2051] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:03.735928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:03.751154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61319c72-5993-4e56-8948-1f411b540188 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:03.757213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:03.758365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.758839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.759563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] PATH_INFO: `/v3/projects/bf0ac388e7f346d7b1ee27105f26a6ed/users/19713b8f03894c64a813ac3bb5dffcc7/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.780453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0ac388e7f346d7b1ee27105f26a6ed, user_id=19713b8f03894c64a813ac3bb5dffcc7, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:03.784021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:03.813020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1022/2052] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:03 2021] PUT /identity/v3/projects/bf0ac388e7f346d7b1ee27105f26a6ed/users/19713b8f03894c64a813ac3bb5dffcc7/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:03.824728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:03.825027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:03.825314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:03.899408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] MFA Rules not processed for user `19713b8f03894c64a813ac3bb5dffcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:03.901027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:03.995243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1031/2053] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:03.999789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.143411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41f4f2-c6f8-4e15-8cb3-e43aa27209af admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:04.156043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:04.156872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.157676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.157676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.158429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:04.166246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:04.213069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1023/2054] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:03 2021] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:04.216632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.255843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e9e58-2c35-4cad-9242-701f515c7221 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:04.340893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:04.342365 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.342972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.343864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.345444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:04.351273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:04.389914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1032/2055] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:04 2021] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:04.393739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.408573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091601f-08da-42fd-ac57-156b754d8083 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:04.423708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:04.424412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.424696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.424973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.425714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:04.428212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:04.456210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1024/2056] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:04 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:04.458305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.481070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b5c98-1f76-4529-961c-fca39287bbd5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:04.497224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:04.498923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.499224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.500931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] PATH_INFO: `/v3/projects/8959615ba4414f84a406d780e070a8ea/users/b306470927234a99bd7c57aaa8d8b2ac/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.542333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8959615ba4414f84a406d780e070a8ea, user_id=b306470927234a99bd7c57aaa8d8b2ac, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:04.548558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:04.603020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1033/2057] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:04 2021] PUT /identity/v3/projects/8959615ba4414f84a406d780e070a8ea/users/b306470927234a99bd7c57aaa8d8b2ac/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:04.604517 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.619252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6a22-f584-4d79-b7ba-70fc5bafc7b9 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:04.694952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a1e8d-9195-4c42-ad0d-9f626a0e3759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:04.695862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1e8d-9195-4c42-ad0d-9f626a0e3759 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.696184 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1e8d-9195-4c42-ad0d-9f626a0e3759 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.696487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1e8d-9195-4c42-ad0d-9f626a0e3759 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.697224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a1e8d-9195-4c42-ad0d-9f626a0e3759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:04.698850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a1e8d-9195-4c42-ad0d-9f626a0e3759 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:04.711278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1025/2058] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:04 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:04.716064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.729641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b4a5-017e-4fca-b894-0e841ce301e0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:04.746445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:04.747435 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.747722 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.748004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] PATH_INFO: `/v3/projects/8959615ba4414f84a406d780e070a8ea/users/b306470927234a99bd7c57aaa8d8b2ac/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.754148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8959615ba4414f84a406d780e070a8ea, user_id=b306470927234a99bd7c57aaa8d8b2ac, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:04.759995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:04.799374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1034/2059] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:04 2021] PUT /identity/v3/projects/8959615ba4414f84a406d780e070a8ea/users/b306470927234a99bd7c57aaa8d8b2ac/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:04.803455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:04.803874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:04.804286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:04.860504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] MFA Rules not processed for user `b306470927234a99bd7c57aaa8d8b2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:04.863692 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:04.979481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1026/2060] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:04 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:04.991465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:04.993861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:05.113602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a037d83-2d0b-41b0-b93d-f2ec44f10ad9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:05.121712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:05.122492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:05.122892 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:05.123264 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:05.149864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:05.151438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:05.166517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1035/2061] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:04 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:05.268135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:05.281561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d18e-e328-410d-87bc-6866c63044c1 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:05.288543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89b090-e405-408a-9e1e-1033fc5dc2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:05.289429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89b090-e405-408a-9e1e-1033fc5dc2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:05.289975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89b090-e405-408a-9e1e-1033fc5dc2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:05.290397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89b090-e405-408a-9e1e-1033fc5dc2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:05.365753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89b090-e405-408a-9e1e-1033fc5dc2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:05.367279 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89b090-e405-408a-9e1e-1033fc5dc2f3 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:05.376440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1027/2062] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:08.267621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:08.387360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782f60d-186f-431c-a030-d086ac83f51f service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:08.392863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:08.398941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:08.398941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:08.399178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] PATH_INFO: `/v3/users/19713b8f03894c64a813ac3bb5dffcc7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:08.400484 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19713b8f03894c64a813ac3bb5dffcc7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:08.402501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:08.478851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19713b8f03894c64a813ac3bb5dffcc7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:08.489755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19713b8f03894c64a813ac3bb5dffcc7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:08.490447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19713b8f03894c64a813ac3bb5dffcc7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:08.526111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19713b8f03894c64a813ac3bb5dffcc7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:08.540205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19713b8f03894c64a813ac3bb5dffcc7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:08.553842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1036/2063] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:08 2021] DELETE /identity/v3/users/19713b8f03894c64a813ac3bb5dffcc7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:08.558501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:08.559403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:08.559836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:08.609077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:08.610594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:08.741369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1028/2064] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:08.767611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:08.769175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:08.904272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e4a2-7afd-4c82-8f6e-74d83e77092c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:08.909033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91861-6101-49c7-9fbb-6354a0fb751b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:08.909947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91861-6101-49c7-9fbb-6354a0fb751b service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:08.911673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91861-6101-49c7-9fbb-6354a0fb751b service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:08.912361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91861-6101-49c7-9fbb-6354a0fb751b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:08.947190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e91861-6101-49c7-9fbb-6354a0fb751b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:08.950270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e91861-6101-49c7-9fbb-6354a0fb751b service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:08.963705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1037/2065] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:09.890893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:09.896113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:09.919819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98667e6e-8236-4218-b6c6-cad913f74b67 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:09.935981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:09.936966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:09.938381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:09.939765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] PATH_INFO: `/v3/projects/bf0ac388e7f346d7b1ee27105f26a6ed` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:09.941097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0ac388e7f346d7b1ee27105f26a6ed)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:09.944504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:09.959979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:09.960717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:09.961101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:10.004374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] MFA Rules not processed for user `f80f1abf0ffa49e29e21a2b59b12330a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:10.006601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:10.060510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0ac388e7f346d7b1ee27105f26a6ed', 'request_id': 'req-015aaa5a-47dd-47c9-98d7-a5471c9794a8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.073065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0ac388e7f346d7b1ee27105f26a6ed', 'request_id': 'req-015aaa5a-47dd-47c9-98d7-a5471c9794a8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.092624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0ac388e7f346d7b1ee27105f26a6ed', 'request_id': 'req-015aaa5a-47dd-47c9-98d7-a5471c9794a8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.120023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] The token cache is being invalidate because project bf0ac388e7f346d7b1ee27105f26a6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:10.120307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.120981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.123386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1029/2066] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:09 2021] DELETE /identity/v3/projects/bf0ac388e7f346d7b1ee27105f26a6ed => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:10.128453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:10.132101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:10.150876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1038/2067] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:09 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:10.261423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aaa5a-47dd-47c9-98d7-a5471c9794a8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:10.267666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:10.268362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:10.268652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:10.268958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] PATH_INFO: `/v3/users/b306470927234a99bd7c57aaa8d8b2ac` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:10.270303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b306470927234a99bd7c57aaa8d8b2ac)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:10.273646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:10.309119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:10.310573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:10.370849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b306470927234a99bd7c57aaa8d8b2ac'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.371854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b306470927234a99bd7c57aaa8d8b2ac'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.381469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b306470927234a99bd7c57aaa8d8b2ac'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.390797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b306470927234a99bd7c57aaa8d8b2ac'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.391490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b306470927234a99bd7c57aaa8d8b2ac'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.407755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267baed-1b82-41d3-86fe-4863a6b42aed None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:10.416196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1030/2068] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:10 2021] DELETE /identity/v3/users/b306470927234a99bd7c57aaa8d8b2ac => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:10.476193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:10.476996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:10.477339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:10.477683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:10.480205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:10.545923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:10.547603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629236e-576b-4b20-86d8-dc9c63805d15 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:10.557778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1039/2069] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:10 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:42:10.763954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:10.769871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:10.862272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ecff-d80e-4cb3-bff3-1c78dfd0b295 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:10.867052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:10.867943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:10.868221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:10.868488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] PATH_INFO: `/v3/projects/8959615ba4414f84a406d780e070a8ea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:10.869625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8959615ba4414f84a406d780e070a8ea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:10.872339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:10.948047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8959615ba4414f84a406d780e070a8ea', 'request_id': 'req-16250023-d289-4abe-96b3-d502bd7d9db5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.957193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8959615ba4414f84a406d780e070a8ea', 'request_id': 'req-16250023-d289-4abe-96b3-d502bd7d9db5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.970392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8959615ba4414f84a406d780e070a8ea', 'request_id': 'req-16250023-d289-4abe-96b3-d502bd7d9db5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.987407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] The token cache is being invalidate because project 8959615ba4414f84a406d780e070a8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:10.988550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.989843 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-16250023-d289-4abe-96b3-d502bd7d9db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:10.995008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1031/2070] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:10 2021] DELETE /identity/v3/projects/8959615ba4414f84a406d780e070a8ea => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:10.998302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:10.998817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:10.998955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.025992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:11.027313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:11.105087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1040/2071] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:11.112371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.112661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.112940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.134999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:11.136200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:11.143845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1032/2072] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:11.148900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.159218 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a23208-48cd-4527-9df7-d5da00ccce79 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.165254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.166145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.166446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.166721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.167587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:11.167891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.169581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.185085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1041/2073] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:42:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:11.189583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.200431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299e0b7-23d3-4ff4-adaa-663d4e8c1233 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.205958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.206208 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.206656 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.207183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.208861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.211042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.250686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1033/2074] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:11 2021] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:11.254549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.269279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fb84e-2a20-4afb-9e2d-425b74c8ffc4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.339143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.339829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.340116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.340390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.341099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.343063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.371731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1042/2075] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:11 2021] POST /identity/v3/users => generated 281 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:11.373657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.393101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bdc2-b94f-47c3-bfad-379b9e0c472f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.402141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.402828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.403125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.403399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.404128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.405715 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.417970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1034/2076] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:11 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:11.423918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.435474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c77fb7-d115-4fc8-b897-eb246d3aa03b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.441228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ac5ab-f913-4c9e-b4e2-862632c3fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.441945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac5ab-f913-4c9e-b4e2-862632c3fcda admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.442768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac5ab-f913-4c9e-b4e2-862632c3fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.443212 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac5ab-f913-4c9e-b4e2-862632c3fcda admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.443962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac5ab-f913-4c9e-b4e2-862632c3fcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.445615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac5ab-f913-4c9e-b4e2-862632c3fcda admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.456706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1043/2077] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:11.461932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.472940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36859-b4c2-4b0f-902f-68bcefe9ec43 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.479225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e256-bee7-4075-9805-5490ac4483d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.480485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e256-bee7-4075-9805-5490ac4483d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.480962 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e256-bee7-4075-9805-5490ac4483d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.481558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e256-bee7-4075-9805-5490ac4483d7 admin admin] PATH_INFO: `/v3/projects/a46d120f2d5d414b8c116f6b9c90fe54/users/44804af1af234532a0fa0d510bc7e604/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.503140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e256-bee7-4075-9805-5490ac4483d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46d120f2d5d414b8c116f6b9c90fe54, user_id=44804af1af234532a0fa0d510bc7e604, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.508165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e256-bee7-4075-9805-5490ac4483d7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.527276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1035/2078] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:11 2021] PUT /identity/v3/projects/a46d120f2d5d414b8c116f6b9c90fe54/users/44804af1af234532a0fa0d510bc7e604/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:11.538099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55bdeb-a3a1-44a3-b57f-57182ea77014 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.538398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55bdeb-a3a1-44a3-b57f-57182ea77014 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.538683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55bdeb-a3a1-44a3-b57f-57182ea77014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.578736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-7a55bdeb-a3a1-44a3-b57f-57182ea77014 None None] MFA Rules not processed for user `44804af1af234532a0fa0d510bc7e604`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:11.580408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7a55bdeb-a3a1-44a3-b57f-57182ea77014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:11.667797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1044/2079] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:11 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:11.696645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbe99-0a18-4df9-9bab-1aeb6dfb466a None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.697168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbe99-0a18-4df9-9bab-1aeb6dfb466a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.697658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbe99-0a18-4df9-9bab-1aeb6dfb466a None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.701116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1036/2080] 10.222.0.66 () {54 vars in 963 bytes} [Tue Jul 13 08:42:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:42:11.706750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.706750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.706750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.726059 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] MFA Rules not processed for user `679ea61fafe040cdb5235aae7ff59f81`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:11.727408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:11.794154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1045/2081] 10.222.0.66 () {58 vars in 1061 bytes} [Tue Jul 13 08:42:11 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:11.801946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbe99-0a18-4df9-9bab-1aeb6dfb466a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:11.812900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbe99-0a18-4df9-9bab-1aeb6dfb466a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:11.817082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85643881-75de-4b88-a29f-5889ebc11147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:11.818263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643881-75de-4b88-a29f-5889ebc11147 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:11.818732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643881-75de-4b88-a29f-5889ebc11147 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:11.819211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643881-75de-4b88-a29f-5889ebc11147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:11.840205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643881-75de-4b88-a29f-5889ebc11147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:11.841789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643881-75de-4b88-a29f-5889ebc11147 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:11.854028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1037/2082] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:11 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:12.253399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:12.383089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484832e-6bb8-4a03-babb-00d3161cfd3d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:12.389330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:12.390856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:12.391185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:12.391466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] PATH_INFO: `/v3/users/44804af1af234532a0fa0d510bc7e604` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:12.393133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44804af1af234532a0fa0d510bc7e604)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:12.395914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:12.478252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44804af1af234532a0fa0d510bc7e604'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:12.485873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44804af1af234532a0fa0d510bc7e604'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:12.486624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44804af1af234532a0fa0d510bc7e604'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:12.500014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44804af1af234532a0fa0d510bc7e604'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:12.512630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44804af1af234532a0fa0d510bc7e604'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:12.524932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1046/2083] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:12 2021] DELETE /identity/v3/users/44804af1af234532a0fa0d510bc7e604 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:12.528989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05e53-21d3-46f2-879d-6416f90a7f8c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:12.529501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05e53-21d3-46f2-879d-6416f90a7f8c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:12.529600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef05e53-21d3-46f2-879d-6416f90a7f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:12.551166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8ef05e53-21d3-46f2-879d-6416f90a7f8c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:12.553256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8ef05e53-21d3-46f2-879d-6416f90a7f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:12.696209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1038/2084] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:12.706181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:12.708339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:12.756629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fff6c-024b-4125-942b-6a26383bb41d None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:12.757008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fff6c-024b-4125-942b-6a26383bb41d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:12.757285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fff6c-024b-4125-942b-6a26383bb41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:12.775303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-eb8fff6c-024b-4125-942b-6a26383bb41d None None] MFA Rules not processed for user `f80f1abf0ffa49e29e21a2b59b12330a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:12.776576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-eb8fff6c-024b-4125-942b-6a26383bb41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:12.779441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991201f8-5c54-4a40-b63a-b2460b95f76a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:12.784304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:12.784950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:12.785226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:12.785489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:12.795573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:12.797064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:12.808897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1047/2085] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:12.857125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1039/2086] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:12 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:13.415145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:13.418557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:13.471565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ade784-449b-4a3f-94c3-aa5a2cf34e6c service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:13.481814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:13.483022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:13.484686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:13.485492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] PATH_INFO: `/v3/projects/a46d120f2d5d414b8c116f6b9c90fe54` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:13.488648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46d120f2d5d414b8c116f6b9c90fe54)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:13.492235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:13.550620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46d120f2d5d414b8c116f6b9c90fe54', 'request_id': 'req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:13.556741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46d120f2d5d414b8c116f6b9c90fe54', 'request_id': 'req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:13.570267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46d120f2d5d414b8c116f6b9c90fe54', 'request_id': 'req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:13.584965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] The token cache is being invalidate because project a46d120f2d5d414b8c116f6b9c90fe54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:13.585166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:13.585828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7ff3c3af-d0ad-4fa5-8668-8617abeb62d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:13.587444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1048/2087] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:13 2021] DELETE /identity/v3/projects/a46d120f2d5d414b8c116f6b9c90fe54 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:13.597261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:13.597827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:13.597973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:13.630553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:13.632501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:13.732101 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1040/2088] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:13.740277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:13.740574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:13.740857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:13.767492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:13.768688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:13.780947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1049/2089] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:13.782188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:13.793506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d00f-66d1-4cc3-90b4-3b4ac6027a25 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:13.807201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:13.808439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:13.808805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:13.809090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:13.810044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:13.810159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:13.811817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:13.825111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1041/2090] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:42:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:13.829341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:13.843785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f238-a637-440e-904c-0abaf735da6e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:13.851039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:13.851822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:13.853085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:13.853555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:13.854619 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:13.856758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:13.898566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1050/2091] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:13 2021] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:13.902655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:13.915594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a6be-43bc-475d-acf3-9bdb09fb48ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:13.992687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:13.993370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:13.993651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:13.993928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:13.994624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:13.996596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:14.022862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1042/2092] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:13 2021] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:14.027061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:14.040459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c992f-785c-4ebd-bfd7-2eacdfa937b2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:14.045155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:14.045979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:14.046270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:14.046692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:14.047477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:14.049099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:14.061631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1051/2093] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:14.065656 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:14.076423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6caf8-5968-4442-9067-115213497282 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:14.081155 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada73fd8-28d4-4671-8838-bf6a53d8fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:14.082026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada73fd8-28d4-4671-8838-bf6a53d8fdad admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:14.082509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada73fd8-28d4-4671-8838-bf6a53d8fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:14.082974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada73fd8-28d4-4671-8838-bf6a53d8fdad admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:14.084050 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada73fd8-28d4-4671-8838-bf6a53d8fdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:14.085690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada73fd8-28d4-4671-8838-bf6a53d8fdad admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:14.101397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1043/2094] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:14 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:14.105410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:14.116747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1d44-b639-4d02-8c07-30ea706bee18 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:14.124249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:14.125569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:14.125972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:14.126421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] PATH_INFO: `/v3/projects/3d061e9ae6724c5db2f75e0261fdf14f/users/b41ed9fe98754496b1cf574c0cac61d7/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:14.144397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d061e9ae6724c5db2f75e0261fdf14f, user_id=b41ed9fe98754496b1cf574c0cac61d7, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:14.147629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:14.163257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1052/2095] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:14 2021] PUT /identity/v3/projects/3d061e9ae6724c5db2f75e0261fdf14f/users/b41ed9fe98754496b1cf574c0cac61d7/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:14.174303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42ec69-47a9-41d2-9398-d58328a9d925 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:14.174600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42ec69-47a9-41d2-9398-d58328a9d925 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:14.174878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42ec69-47a9-41d2-9398-d58328a9d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:14.204476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-bd42ec69-47a9-41d2-9398-d58328a9d925 None None] MFA Rules not processed for user `b41ed9fe98754496b1cf574c0cac61d7`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:14.205791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bd42ec69-47a9-41d2-9398-d58328a9d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:14.333080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1044/2096] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:14 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:14.340469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:14.342259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:14.482095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c9bc3-6ae0-4687-beb9-9248b18dc71f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:14.509493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:14.510230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:14.510520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:14.511193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:14.542456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:14.544135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:14.566130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1053/2097] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:14 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:16.289828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693977-0f27-40e4-ad8b-dcc7f97b0d79 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:16.290361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693977-0f27-40e4-ad8b-dcc7f97b0d79 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:16.290361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693977-0f27-40e4-ad8b-dcc7f97b0d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:16.310879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a2693977-0f27-40e4-ad8b-dcc7f97b0d79 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:16.312163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a2693977-0f27-40e4-ad8b-dcc7f97b0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:16.377424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1045/2098] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:42:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:16.435276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:16.437348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:16.561145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd9160-0cc3-4468-b35d-6e301c9a81b4 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:16.581835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:16.584083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:16.586813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:16.587391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:16.610033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:16.611898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:16.634251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1054/2099] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:42:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:42:17.651702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bac7-a39e-410a-a937-f8dd403dff3a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:17.652185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bac7-a39e-410a-a937-f8dd403dff3a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:17.652295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bac7-a39e-410a-a937-f8dd403dff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:17.670452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8670bac7-a39e-410a-a937-f8dd403dff3a None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:17.671661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8670bac7-a39e-410a-a937-f8dd403dff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:17.681430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1046/2100] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:42:17 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:17.700634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:17.710757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae85fb-6378-4f0e-ab4d-dcebb5720601 service swift] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:17.716655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:17.717308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:17.717594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:17.717994 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:17.726597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:17.729084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:17.737541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1055/2101] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:42:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 08:42:18.117252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:18.117551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:18.118475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:18.138887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:18.140127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:18.147402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1047/2102] 10.222.0.66 () {58 vars in 968 bytes} [Tue Jul 13 08:42:18 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:18.160135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:18.171429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bd712-7083-492d-9b1d-413221efaa23 service swift] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:18.177313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d618c27-ca18-4fc1-92b2-27643a3b80dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:18.178460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d618c27-ca18-4fc1-92b2-27643a3b80dc service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:18.179116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d618c27-ca18-4fc1-92b2-27643a3b80dc service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:18.179602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d618c27-ca18-4fc1-92b2-27643a3b80dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:18.188557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d618c27-ca18-4fc1-92b2-27643a3b80dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:18.190601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d618c27-ca18-4fc1-92b2-27643a3b80dc service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:18.199712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1056/2103] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:42:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:42:27.677429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:27.678873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:27.783568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0167fe2-d44a-4b36-8497-f109da5112a1 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:27.792197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:27.793153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:27.793438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:27.793714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] PATH_INFO: `/v3/users/a99a78a99f7d48e4b48f221a71dcd2e6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:27.794979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99a78a99f7d48e4b48f221a71dcd2e6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:27.797080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:27.841308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99a78a99f7d48e4b48f221a71dcd2e6'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:27.841981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99a78a99f7d48e4b48f221a71dcd2e6'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:27.849111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99a78a99f7d48e4b48f221a71dcd2e6'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:27.856060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99a78a99f7d48e4b48f221a71dcd2e6'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:27.856697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99a78a99f7d48e4b48f221a71dcd2e6'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:27.874127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1048/2104] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:27 2021] DELETE /identity/v3/users/a99a78a99f7d48e4b48f221a71dcd2e6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:27.878930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:27.879729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:27.880013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:27.898350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:27.899582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:27.955524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1057/2105] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:27.966466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:27.967869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.024777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a521c9-b924-498a-95c3-1f810aa14e5b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.028609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3471838-83cc-4635-bc74-47b5ab9c17b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.029170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471838-83cc-4635-bc74-47b5ab9c17b9 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.029452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471838-83cc-4635-bc74-47b5ab9c17b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.029725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3471838-83cc-4635-bc74-47b5ab9c17b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.038717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3471838-83cc-4635-bc74-47b5ab9c17b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.040105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3471838-83cc-4635-bc74-47b5ab9c17b9 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.049081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1049/2106] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:28.229870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.231445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.253211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72133b-0e92-45ff-9cbe-96919722ffd2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.259816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.260707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.260989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.261293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] PATH_INFO: `/v3/projects/e68bd061e90443899994b6f855aa27fa` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.262433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68bd061e90443899994b6f855aa27fa)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.264408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.312742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68bd061e90443899994b6f855aa27fa', 'request_id': 'req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:28.318555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68bd061e90443899994b6f855aa27fa', 'request_id': 'req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:28.327680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68bd061e90443899994b6f855aa27fa', 'request_id': 'req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:28.339684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] The token cache is being invalidate because project e68bd061e90443899994b6f855aa27fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:28.339966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:28.340598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bd129eb1-5b77-4cac-bfcc-8adbc12915c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:28.342135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1058/2107] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:28 2021] DELETE /identity/v3/projects/e68bd061e90443899994b6f855aa27fa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:28.348810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.349091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.349375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.367417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:28.368593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.429473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1050/2108] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:28.436832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.437116 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.437392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.455631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:28.456774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.464234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1059/2109] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:28.468784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.478273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5f1a4-9cca-466f-acb7-812bf8e12e56 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.482786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.483433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.483720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.483998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.484722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:28.485034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.486665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23ca0-a37d-4d29-bf42-04cb053d8274 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.499409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1051/2110] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:42:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:28.504443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.512948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da5e2e-e2e6-4b4c-989c-9e022cc8318d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.517383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.518030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.518315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.518597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.519319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.521770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.553788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1060/2111] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:28.554105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb205-4c46-471f-a414-fadbe8ec9788 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.554516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb205-4c46-471f-a414-fadbe8ec9788 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.554874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb205-4c46-471f-a414-fadbe8ec9788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.557803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.573652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1e9cb205-4c46-471f-a414-fadbe8ec9788 None None] MFA Rules not processed for user `947339dfaadf40179623b4d8f07b1415`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:28.574945 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1e9cb205-4c46-471f-a414-fadbe8ec9788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.629946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30f21-fe5a-4bff-a2ab-0f0cfefaaa6d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.635007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.635678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.635958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.636229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.636908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.638862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.642341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1052/2112] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:28.645270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.645270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.645270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.661259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1061/2113] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:28.662575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] MFA Rules not processed for user `b84cbe113bf545c19654aed0a6049694`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:28.663853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.665243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.675260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c45da-b3fa-4700-8ef1-23735c3729f0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.680179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.680869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.681125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.681402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.682131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.683813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.694926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1062/2114] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:28.698638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.709066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d7a95-9024-462e-b11b-6c6239c5df88 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.713699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d99eb-b191-428f-9369-aa0cc4a42b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.714361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d99eb-b191-428f-9369-aa0cc4a42b69 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.714643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d99eb-b191-428f-9369-aa0cc4a42b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.714959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d99eb-b191-428f-9369-aa0cc4a42b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.715669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d99eb-b191-428f-9369-aa0cc4a42b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.717270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d99eb-b191-428f-9369-aa0cc4a42b69 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.721885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1053/2115] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:28.730004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1063/2116] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:28.734476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.745362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b970af8-0eca-4a7f-ae8c-84b7071c85ac None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.749720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.750609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.750899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.751269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] PATH_INFO: `/v3/projects/77f6db6ace1f465f80565405509ad580/users/554c84c95f1a4698b304a1f07fdb6fab/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.766224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f6db6ace1f465f80565405509ad580, user_id=554c84c95f1a4698b304a1f07fdb6fab, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.768944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.783556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1054/2117] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:28 2021] PUT /identity/v3/projects/77f6db6ace1f465f80565405509ad580/users/554c84c95f1a4698b304a1f07fdb6fab/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:28.789280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a62f7-6cff-428c-a81e-177c130aa981 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.790051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a62f7-6cff-428c-a81e-177c130aa981 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.790403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a62f7-6cff-428c-a81e-177c130aa981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.811309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d93a62f7-6cff-428c-a81e-177c130aa981 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:28.812472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d93a62f7-6cff-428c-a81e-177c130aa981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.872548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1064/2118] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:28.882748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:28.884439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:28.939914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90dd3-ce89-4ebd-8775-1f2bab41251a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:28.944126 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:28.944741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:28.945019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:28.945289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:28.953844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:28.955327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:28.964401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1055/2119] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:42:35.956633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:35.959388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:35.959870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.022742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] MFA Rules not processed for user `554c84c95f1a4698b304a1f07fdb6fab`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:36.024011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:36.112027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1065/2120] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:35 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:36.116422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.129671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccd448-e671-49ea-a2ff-c29a15e17483 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.136840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.138054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.138500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.138903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.139968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.142529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.177053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.183914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1056/2121] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:36 2021] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:36.188357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be671c-2886-47e2-8e1b-7ae4156c8dd9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.247431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.249858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:36.319881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.320607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.320903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.321188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.321920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.324168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.372492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd92f2-0be5-48d8-a223-9783ac651362 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.387723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1066/2122] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:36 2021] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:36.389187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.391394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.392431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.392823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.393198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] PATH_INFO: `/v3/users/32181fcbb99f44a2977818d00229b90c` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.396418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32181fcbb99f44a2977818d00229b90c)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.399015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.404250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5e51-f637-4a56-92c0-6e524aca4527 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.411128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.422432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.422859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.423410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.424278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.427406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.446433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1067/2123] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:36 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:36.447651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.462929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736b6b-32fa-4030-8546-665696c0b256 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.475641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.476843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.477214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.477589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] PATH_INFO: `/v3/projects/831e2990de3942e49ee57a05d7769b9d/users/145f6e73d21b401f96a8638b73bba4ee/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.490102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32181fcbb99f44a2977818d00229b90c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:36.491292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32181fcbb99f44a2977818d00229b90c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:36.510477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e2990de3942e49ee57a05d7769b9d, user_id=145f6e73d21b401f96a8638b73bba4ee, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.511385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32181fcbb99f44a2977818d00229b90c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:36.514776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.523866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32181fcbb99f44a2977818d00229b90c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:36.524494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e900d178-9efd-4f7d-9f5f-4baa1bd7c8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32181fcbb99f44a2977818d00229b90c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:36.558230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1068/2124] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:36 2021] PUT /identity/v3/projects/831e2990de3942e49ee57a05d7769b9d/users/145f6e73d21b401f96a8638b73bba4ee/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:42:36.562611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.565176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:36.568210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1057/2125] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:36 2021] DELETE /identity/v3/users/32181fcbb99f44a2977818d00229b90c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:36.576959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.577296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.577854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.600310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:36.601762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:36.696250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1058/2126] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:36.703598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.706008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:36.806108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac7133-4c02-4b5a-ba1d-8700c9b95314 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.810762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.811524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.811807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.812097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.821099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.821099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.838087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886d684-2456-42d4-9d17-33c7e7e4ad01 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.844003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1069/2127] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:36 2021] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:36.846045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:36.848262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.849739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.850283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.850704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.866602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.869235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.873693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b1e3-6fbe-4624-b8d5-f73b13e353c0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:36.890240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1059/2128] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:42:36.904406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:36.905347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:36.905632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:36.905910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] PATH_INFO: `/v3/projects/831e2990de3942e49ee57a05d7769b9d/users/145f6e73d21b401f96a8638b73bba4ee/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:36.911876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e2990de3942e49ee57a05d7769b9d, user_id=145f6e73d21b401f96a8638b73bba4ee, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:36.917463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:36.950016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1070/2129] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:36 2021] PUT /identity/v3/projects/831e2990de3942e49ee57a05d7769b9d/users/145f6e73d21b401f96a8638b73bba4ee/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:37.856404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:37.858534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:37.880802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3c3df-9774-4b1d-b8ee-33c8c0e2df80 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:37.899703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:37.903172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:37.980848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:37.983245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:37.984413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:37.984712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] PATH_INFO: `/v3/users/b41ed9fe98754496b1cf574c0cac61d7` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:37.988406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41ed9fe98754496b1cf574c0cac61d7)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:37.994512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.057411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79883-fbfe-467b-9a2e-d67c77b57bbe admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.073480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.074368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.074663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.074964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] PATH_INFO: `/v3/projects/7ef75c99e94242f4872915d6c654997d` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.076860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef75c99e94242f4872915d6c654997d)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.081047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.101441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41ed9fe98754496b1cf574c0cac61d7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.102113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41ed9fe98754496b1cf574c0cac61d7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.109787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41ed9fe98754496b1cf574c0cac61d7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.120134 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41ed9fe98754496b1cf574c0cac61d7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.121085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0e1ebd76-930e-40f5-b40f-2933dcec6168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41ed9fe98754496b1cf574c0cac61d7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.157020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1060/2130] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:42:37 2021] DELETE /identity/v3/users/b41ed9fe98754496b1cf574c0cac61d7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:38.164212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.164513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.165705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.173864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef75c99e94242f4872915d6c654997d', 'request_id': 'req-bb5cd195-bb72-483e-b392-f2e06e1f277b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.182065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef75c99e94242f4872915d6c654997d', 'request_id': 'req-bb5cd195-bb72-483e-b392-f2e06e1f277b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.190221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:38.192505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:38.194428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef75c99e94242f4872915d6c654997d', 'request_id': 'req-bb5cd195-bb72-483e-b392-f2e06e1f277b'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.219204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] The token cache is being invalidate because project 7ef75c99e94242f4872915d6c654997d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:38.219868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.221181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bb5cd195-bb72-483e-b392-f2e06e1f277b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:38.228759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1071/2131] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:37 2021] DELETE /identity/v3/projects/7ef75c99e94242f4872915d6c654997d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:42:38.231948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edc666-5509-4db9-847c-e2ae9f49e59c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.232460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edc666-5509-4db9-847c-e2ae9f49e59c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.233071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edc666-5509-4db9-847c-e2ae9f49e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.264935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-80edc666-5509-4db9-847c-e2ae9f49e59c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:38.266190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-80edc666-5509-4db9-847c-e2ae9f49e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:38.292994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1061/2132] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:38.299991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.302972 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:38.359379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1072/2133] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:38.364769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.366070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.368194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.393401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186893fc-c35b-448b-a8b6-14e6d4164bed None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.398853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:38.400588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:38.404347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.405017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.405304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.405582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.419329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1073/2134] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:42:38.420899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.422035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.423136 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.437393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c9f06-424a-4554-bd0b-f3932a90bac8 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.445054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1062/2135] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:38.453916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.457936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.458411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.459345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.461629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:42:38.461629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.464971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.509006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1074/2136] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:42:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:42:38.513269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.525868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f99631-21d3-4a95-84d8-7a48def2d210 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.537643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.538460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.538795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.539405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.540102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.542109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.599495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1063/2137] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:38 2021] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:38.600974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.615056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdf4a2-51fc-4be7-9774-e81029a94a09 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.782065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.788576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.788576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.788576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.793085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.797422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.858104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1075/2138] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:38 2021] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:42:38.859594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.869915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b23a5-f5c5-4bf3-a876-13d79d3c2c1c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.875531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.876604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.877149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.877634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.878802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.880929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.895199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1064/2139] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:38 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:38.899613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.913917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414bb2d-8a74-4871-be08-7167a0d9ae7c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.928552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cbea5-a933-4d62-8d95-41080ebf2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.929234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cbea5-a933-4d62-8d95-41080ebf2242 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.929660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cbea5-a933-4d62-8d95-41080ebf2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.930119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cbea5-a933-4d62-8d95-41080ebf2242 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.930851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cbea5-a933-4d62-8d95-41080ebf2242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.932628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cbea5-a933-4d62-8d95-41080ebf2242 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:38.952413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1076/2140] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:38 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:42:38.954575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:38.965788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1a1a9-815e-4893-ba90-6b1dc627d3a3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:38.971577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:38.973107 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:38.973640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:38.974123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] PATH_INFO: `/v3/projects/67cbac86d97d489eb40a43295448932f/users/63c27996c23541bb92fab4e184bea407/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:38.993996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cbac86d97d489eb40a43295448932f, user_id=63c27996c23541bb92fab4e184bea407, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:38.997037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:39.013753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1065/2141] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:38 2021] PUT /identity/v3/projects/67cbac86d97d489eb40a43295448932f/users/63c27996c23541bb92fab4e184bea407/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:39.023373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:39.024039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:39.024508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:39.062590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:39.063823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:39.207921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1077/2142] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:39.219798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:39.347926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7f76-d27d-43a1-9cd9-e02cf391dcf8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:39.352840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f509f6-853f-4618-9c22-9ed189c7053e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:39.354251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f509f6-853f-4618-9c22-9ed189c7053e service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:39.354704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f509f6-853f-4618-9c22-9ed189c7053e service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:39.355187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f509f6-853f-4618-9c22-9ed189c7053e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:39.371710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f509f6-853f-4618-9c22-9ed189c7053e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:39.373616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f509f6-853f-4618-9c22-9ed189c7053e service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:39.395813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1066/2143] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:39.647536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:39.648527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:39.673422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84fc80-d89e-4eeb-ab1b-9f934a20da56 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:39.680536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:39.681424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:39.681709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:39.681982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] PATH_INFO: `/v3/projects/3d061e9ae6724c5db2f75e0261fdf14f` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:39.685767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d061e9ae6724c5db2f75e0261fdf14f)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:39.687748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:39.769905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d061e9ae6724c5db2f75e0261fdf14f', 'request_id': 'req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:39.785222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d061e9ae6724c5db2f75e0261fdf14f', 'request_id': 'req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:39.796299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d061e9ae6724c5db2f75e0261fdf14f', 'request_id': 'req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:39.819597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] The token cache is being invalidate because project 3d061e9ae6724c5db2f75e0261fdf14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:42:39.821226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:39.822172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:42:39.826029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1078/2144] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:42:39 2021] DELETE /identity/v3/projects/3d061e9ae6724c5db2f75e0261fdf14f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:46.795480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ecf8-390a-4f53-81db-395cd124f5c1 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:46.795990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ecf8-390a-4f53-81db-395cd124f5c1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:46.796077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ecf8-390a-4f53-81db-395cd124f5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:46.833432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5fa4ecf8-390a-4f53-81db-395cd124f5c1 None None] MFA Rules not processed for user `145f6e73d21b401f96a8638b73bba4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:46.834790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5fa4ecf8-390a-4f53-81db-395cd124f5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:46.990604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1067/2145] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:46 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:47.482166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:47.483580 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:47.621562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3c84f-3c38-4ecc-a995-ffc5ac32c348 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:47.630585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:47.631347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:47.631641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:47.631926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:47.633684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:47.751915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:47.754351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:47.795678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1079/2146] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:47 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:50.569739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.570645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.572497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.632350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] MFA Rules not processed for user `63c27996c23541bb92fab4e184bea407`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:50.633903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:50.805952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1068/2147] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:50.810707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.812350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:50.899726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f20eed-76e3-4608-9580-15bf8bdc40f9 service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:50.904174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:50.905113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:50.905462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:50.905809 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:50.906609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:50.908942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:50.942613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1080/2148] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:42:50 2021] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:50.946734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:50.990707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464e763-f00b-4868-a259-615970c5bbd4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.090534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.092169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.093828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.094125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.094840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.098412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.138135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1069/2149] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:42:50 2021] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:42:51.142618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:51.153612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe58d6-3c0b-4491-b11c-b4389ff51b10 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.163379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.164252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.164609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.164952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.165941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.170681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.200443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1081/2150] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:51 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:51.204776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:51.222747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfec356-609d-40b8-a8f1-d7df6a5481e8 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.233883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.238248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.239065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.240526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] PATH_INFO: `/v3/projects/07d87b8ac3fa4e0eb1245d985842a0f6/users/f0bf3b502d9c4a7dbc026388c06c1ca7/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.297393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d87b8ac3fa4e0eb1245d985842a0f6, user_id=f0bf3b502d9c4a7dbc026388c06c1ca7, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.303098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.330321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1070/2151] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:51 2021] PUT /identity/v3/projects/07d87b8ac3fa4e0eb1245d985842a0f6/users/f0bf3b502d9c4a7dbc026388c06c1ca7/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:51.335168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:51.347688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514db5-cae1-4c30-8537-86296b2c8560 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.450194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721802e-51a5-46c5-af84-d155ef5c6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.450904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721802e-51a5-46c5-af84-d155ef5c6d13 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.451249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721802e-51a5-46c5-af84-d155ef5c6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.451522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721802e-51a5-46c5-af84-d155ef5c6d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.452247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721802e-51a5-46c5-af84-d155ef5c6d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.454817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721802e-51a5-46c5-af84-d155ef5c6d13 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.480431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1082/2152] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:42:51 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:42:51.484815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:51.502281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d043b-a8c4-4c94-b678-4ae9b647f28c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:51.519597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:51.521905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:51.522376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:51.522667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] PATH_INFO: `/v3/projects/07d87b8ac3fa4e0eb1245d985842a0f6/users/f0bf3b502d9c4a7dbc026388c06c1ca7/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:51.529110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d87b8ac3fa4e0eb1245d985842a0f6, user_id=f0bf3b502d9c4a7dbc026388c06c1ca7, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:51.538605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:51.572916 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1071/2153] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:42:51 2021] PUT /identity/v3/projects/07d87b8ac3fa4e0eb1245d985842a0f6/users/f0bf3b502d9c4a7dbc026388c06c1ca7/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:42:58.809653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07943b-c6ae-416d-8a43-b5395bc9d3b0 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:58.810201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07943b-c6ae-416d-8a43-b5395bc9d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:58.810201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07943b-c6ae-416d-8a43-b5395bc9d3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:58.889953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2a07943b-c6ae-416d-8a43-b5395bc9d3b0 None None] MFA Rules not processed for user `f0bf3b502d9c4a7dbc026388c06c1ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:58.891383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2a07943b-c6ae-416d-8a43-b5395bc9d3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:59.063725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1083/2154] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:42:58 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:59.082443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.085633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:59.192312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca50de7-ba3d-4f8c-83e6-4b04c09cf763 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.198119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.199171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.199600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.200578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.283500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.285692 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.295424 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1072/2155] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:42:59 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:42:59.558446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5115cc6-673c-4e70-a656-49f7d5573aad None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.559239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5115cc6-673c-4e70-a656-49f7d5573aad None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.559757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5115cc6-673c-4e70-a656-49f7d5573aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.603832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d5115cc6-673c-4e70-a656-49f7d5573aad None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:42:59.605984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d5115cc6-673c-4e70-a656-49f7d5573aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:59.739547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1084/2156] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:42:59 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:42:59.756078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:42:59.757704 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:42:59.834598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e44e11-6239-4cfa-9f93-3940f639670e service glance] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:42:59.840387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:42:59.841416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:42:59.841861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:42:59.842337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:42:59.856455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:42:59.859283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:42:59.871039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1073/2157] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:42:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:43:06.910694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0fde8-702b-4cd3-b7c8-2d661d0393d5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.911334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0fde8-702b-4cd3-b7c8-2d661d0393d5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.911334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0fde8-702b-4cd3-b7c8-2d661d0393d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.931673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a0d0fde8-702b-4cd3-b7c8-2d661d0393d5 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:06.932960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a0d0fde8-702b-4cd3-b7c8-2d661d0393d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:06.942163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1085/2158] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:43:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:43:06.968399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:06.981052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29065f-15f7-499e-8604-4f2f839fb606 service swift] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:06.989158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142586-e049-4e32-8564-b991e891e817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:06.989158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142586-e049-4e32-8564-b991e891e817 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:06.989434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142586-e049-4e32-8564-b991e891e817 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:06.989532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142586-e049-4e32-8564-b991e891e817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:06.998819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142586-e049-4e32-8564-b991e891e817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:07.000798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142586-e049-4e32-8564-b991e891e817 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:07.010564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1074/2159] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:43:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:43:10.667505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aac41-af7a-4a1e-86e2-b5b76719b1ab None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:10.668518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aac41-af7a-4a1e-86e2-b5b76719b1ab None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:10.668996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aac41-af7a-4a1e-86e2-b5b76719b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:10.691543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-bb1aac41-af7a-4a1e-86e2-b5b76719b1ab None None] MFA Rules not processed for user `63c27996c23541bb92fab4e184bea407`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:10.692923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bb1aac41-af7a-4a1e-86e2-b5b76719b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:10.701525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1086/2160] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:43:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:43:11.454766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:11.456074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:11.456074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:11.475208 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] MFA Rules not processed for user `b84cbe113bf545c19654aed0a6049694`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:11.477228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:11.579878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1075/2161] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:43:11 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:43:14.420266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9933-6710-4dc8-90a6-a2968fa40f07 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.421429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9933-6710-4dc8-90a6-a2968fa40f07 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.421882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9933-6710-4dc8-90a6-a2968fa40f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.456150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b37a9933-6710-4dc8-90a6-a2968fa40f07 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:14.457886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b37a9933-6710-4dc8-90a6-a2968fa40f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:14.471196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1087/2162] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:43:14 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:43:14.526304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:14.546154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6fac0-a934-41d0-ab65-7690a109e490 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:14.552547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6647a-d9c2-411d-8592-80d89cce468c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:14.553499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6647a-d9c2-411d-8592-80d89cce468c service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:14.553963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6647a-d9c2-411d-8592-80d89cce468c service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:14.554645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6647a-d9c2-411d-8592-80d89cce468c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:14.567533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6647a-d9c2-411d-8592-80d89cce468c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:14.569409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6647a-d9c2-411d-8592-80d89cce468c service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:14.596788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1076/2163] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:43:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:43:15.681990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:15.683449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:15.684158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:15.727996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] MFA Rules not processed for user `554c84c95f1a4698b304a1f07fdb6fab`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:15.740733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:15.950478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1088/2164] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:43:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:43:27.712621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610d52c-066f-441f-a537-67e1842357bd None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:27.713308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610d52c-066f-441f-a537-67e1842357bd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:27.713308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610d52c-066f-441f-a537-67e1842357bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:27.749194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b610d52c-066f-441f-a537-67e1842357bd None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:43:27.750687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b610d52c-066f-441f-a537-67e1842357bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:27.789074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1077/2165] 10.222.0.66 () {58 vars in 968 bytes} [Tue Jul 13 08:43:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:43:27.805680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:27.851502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d9ae-de21-4ee0-8aab-ffff42f0f6f3 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:27.857048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:27.857739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:27.858099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:27.858449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:27.868680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:27.870737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:27.880451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1089/2166] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:43:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:43:29.947215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610d52c-066f-441f-a537-67e1842357bd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:29.948873 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b610d52c-066f-441f-a537-67e1842357bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:30.068116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610d52c-066f-441f-a537-67e1842357bd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:30.074516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:30.075776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:30.076223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:30.076631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] PATH_INFO: `/v3/users/947339dfaadf40179623b4d8f07b1415` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:30.081321 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947339dfaadf40179623b4d8f07b1415)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:30.083335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:30.142850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947339dfaadf40179623b4d8f07b1415'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:30.144075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947339dfaadf40179623b4d8f07b1415'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:30.152554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947339dfaadf40179623b4d8f07b1415'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:30.160632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947339dfaadf40179623b4d8f07b1415'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:30.161429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947339dfaadf40179623b4d8f07b1415'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:30.179466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1078/2167] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:43:29 2021] DELETE /identity/v3/users/947339dfaadf40179623b4d8f07b1415 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:43:30.812776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:30.824616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50013f-1730-4e41-aa5c-b26507050074 service swift] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:30.940746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:30.941623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:30.941911 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:30.942189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] PATH_INFO: `/v3/projects/e3f4adcfcaff473c81a4ba75e236035e` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:30.943990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f4adcfcaff473c81a4ba75e236035e)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:30.945944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:31.051588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f4adcfcaff473c81a4ba75e236035e', 'request_id': 'req-7098c025-aa19-46aa-9368-20cd7b85b2f6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:31.079424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f4adcfcaff473c81a4ba75e236035e', 'request_id': 'req-7098c025-aa19-46aa-9368-20cd7b85b2f6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:31.093569 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f4adcfcaff473c81a4ba75e236035e', 'request_id': 'req-7098c025-aa19-46aa-9368-20cd7b85b2f6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:31.119933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] The token cache is being invalidate because project e3f4adcfcaff473c81a4ba75e236035e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:43:31.120512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:31.121884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:43:31.135659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1090/2168] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:43:30 2021] DELETE /identity/v3/projects/e3f4adcfcaff473c81a4ba75e236035e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:43:53.461250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:53.462707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:53.542332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ab113-f114-400a-86d9-7629bcb67157 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:53.587732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:53.588399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:53.588676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:53.588950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:53.590699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:53.655799 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:53.657363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:53.667713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1079/2169] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:43:53 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:43:55.526283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:43:55.527711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:55.540242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c025-aa19-46aa-9368-20cd7b85b2f6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:43:55.543708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:43:55.544366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:43:55.544644 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:43:55.544918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:43:55.548692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:43:55.644370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:43:55.647216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1d671-07be-43ab-bf32-5c15500a4c7b service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:43:55.663067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1091/2170] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:43:55 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:01.771324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:01.775445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:01.897762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d02b-b926-44b7-8f07-e56abb27fb70 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:01.904341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:01.905088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:01.905546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:01.905779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:01.908451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:01.921436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:01.924225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:01.939775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1080/2171] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:01 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:11.663092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66952d7-dab9-42bc-bc3f-41589cd31fef None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.663639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66952d7-dab9-42bc-bc3f-41589cd31fef None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.663639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66952d7-dab9-42bc-bc3f-41589cd31fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.695518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f66952d7-dab9-42bc-bc3f-41589cd31fef None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:11.696726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f66952d7-dab9-42bc-bc3f-41589cd31fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:11.775336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1092/2172] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:44:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:11.783472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:11.785521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:11.861010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf44509-39a9-4f99-a627-9c4fbe3b109e service placement] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:11.873244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046a2a2-82e1-4850-8d0b-e7550b8b96ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:11.876324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a2a2-82e1-4850-8d0b-e7550b8b96ca service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:11.876324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a2a2-82e1-4850-8d0b-e7550b8b96ca service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:11.876324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a2a2-82e1-4850-8d0b-e7550b8b96ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:11.892024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046a2a2-82e1-4850-8d0b-e7550b8b96ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:11.893983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046a2a2-82e1-4850-8d0b-e7550b8b96ca service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:11.912296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1081/2173] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:44:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:44:25.962807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4657d4-8be9-4243-ba83-703da6335ea6 None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.963439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4657d4-8be9-4243-ba83-703da6335ea6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.963439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4657d4-8be9-4243-ba83-703da6335ea6 None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:25.965198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1093/2174] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:44:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:25.971951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8362-532e-4530-94f3-a70a7c54f5a0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:25.972592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8362-532e-4530-94f3-a70a7c54f5a0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:25.972592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8362-532e-4530-94f3-a70a7c54f5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.050059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-23fb8362-532e-4530-94f3-a70a7c54f5a0 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:26.052348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-23fb8362-532e-4530-94f3-a70a7c54f5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:26.134759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1082/2175] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:44:25 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:26.148907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4657d4-8be9-4243-ba83-703da6335ea6 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.150642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6f4657d4-8be9-4243-ba83-703da6335ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:26.247426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4657d4-8be9-4243-ba83-703da6335ea6 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.255700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cbbae-02b3-432b-9c93-413ef9f4a7b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.256512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cbbae-02b3-432b-9c93-413ef9f4a7b9 service glance] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.256805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cbbae-02b3-432b-9c93-413ef9f4a7b9 service glance] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.257214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cbbae-02b3-432b-9c93-413ef9f4a7b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.273453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cbbae-02b3-432b-9c93-413ef9f4a7b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.274940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cbbae-02b3-432b-9c93-413ef9f4a7b9 service glance] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.287690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1094/2176] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:26.374476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a88d-72da-4994-bb3b-03f0652f799d None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.374764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a88d-72da-4994-bb3b-03f0652f799d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.375122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a88d-72da-4994-bb3b-03f0652f799d None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.377523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1083/2177] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:44:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:44:26.382895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.383176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.383452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.402286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:26.403573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:26.410808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1095/2178] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:44:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:26.423088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a88d-72da-4994-bb3b-03f0652f799d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:26.424745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5400a88d-72da-4994-bb3b-03f0652f799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:26.437328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a88d-72da-4994-bb3b-03f0652f799d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:26.441827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:26.442502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:26.442783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:26.443193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:26.451689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:26.453563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:26.473380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1084/2179] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:26 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:27.461804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:27.463889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:27.539265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e7b54-ca1b-4156-81ea-109c7a743b1d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:27.544302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:27.545583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:27.545846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:27.546289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] PATH_INFO: `/v3/users/b84cbe113bf545c19654aed0a6049694` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:27.548732 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84cbe113bf545c19654aed0a6049694)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:27.550857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:27.602962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84cbe113bf545c19654aed0a6049694'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:27.611270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84cbe113bf545c19654aed0a6049694'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:27.611953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84cbe113bf545c19654aed0a6049694'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:27.626314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84cbe113bf545c19654aed0a6049694'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:27.634078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-60a5542e-200a-449a-a70b-f061428769a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84cbe113bf545c19654aed0a6049694'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:27.642080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1096/2180] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:27 2021] DELETE /identity/v3/users/b84cbe113bf545c19654aed0a6049694 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:28.112477 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.123627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537029e2-0467-4da6-ad25-9ed0c0fba51e service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.200760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.202068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.202450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.202828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] PATH_INFO: `/v3/projects/5c2c5dcfa6be4ef1ace638c089206e15` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.204774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2c5dcfa6be4ef1ace638c089206e15)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.207594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.295407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2c5dcfa6be4ef1ace638c089206e15', 'request_id': 'req-2dfa5b1b-74f7-417b-8dac-627921236a6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:28.303763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2c5dcfa6be4ef1ace638c089206e15', 'request_id': 'req-2dfa5b1b-74f7-417b-8dac-627921236a6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:28.316521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2c5dcfa6be4ef1ace638c089206e15', 'request_id': 'req-2dfa5b1b-74f7-417b-8dac-627921236a6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:28.330711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] The token cache is being invalidate because project 5c2c5dcfa6be4ef1ace638c089206e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:28.331035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:28.331720 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2dfa5b1b-74f7-417b-8dac-627921236a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:28.333290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1085/2181] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:28 2021] DELETE /identity/v3/projects/5c2c5dcfa6be4ef1ace638c089206e15 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:28.339680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.340022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.340487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.417964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:28.419253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:28.532584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1097/2182] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:28.541235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.541815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.542282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.564787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:28.567541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:28.587082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1086/2183] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:28.588887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.601148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01638e-cd34-4727-b1c1-90eafb0c8ead None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.606850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.608375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.608863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.609874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.611040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:28.611563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.613416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.629832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1098/2184] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:44:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:28.633898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.643745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f451bc-1783-4d6e-b896-f22c90329067 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.669983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.672368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.673673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.674941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.675986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.679616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.712130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1087/2185] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:28 2021] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:44:28.716226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.729887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13358a9-e491-4ade-854b-8853b6ee45cc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.846877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.848090 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.848570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.849031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.850035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.852438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.877954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1099/2186] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:28 2021] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:28.881646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.895339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d10a2-7bf4-45af-bcb8-7045f6896c65 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.900876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.901623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.901913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.902190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.903475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.905405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.920976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1088/2187] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:28 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:28.922889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.932282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1147-eaf6-4579-abd0-ca4007261172 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.936940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa9112-93eb-4ad2-898a-3c5366b10914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.938308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa9112-93eb-4ad2-898a-3c5366b10914 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.939537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa9112-93eb-4ad2-898a-3c5366b10914 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.939819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa9112-93eb-4ad2-898a-3c5366b10914 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.940715 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa9112-93eb-4ad2-898a-3c5366b10914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.942488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa9112-93eb-4ad2-898a-3c5366b10914 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:28.954826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1100/2188] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:28.958762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:28.968286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb561810-299d-44b1-9d38-2c8927ecfb57 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:28.974687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:28.976087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:28.976087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:28.976330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] PATH_INFO: `/v3/projects/20a521c7e85e4a36b2cc981b791cc0a7/users/adb1c41fbfb942f78c2286bb608b7be5/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:28.992103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a521c7e85e4a36b2cc981b791cc0a7, user_id=adb1c41fbfb942f78c2286bb608b7be5, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:28.994933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.016598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1089/2189] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:28 2021] PUT /identity/v3/projects/20a521c7e85e4a36b2cc981b791cc0a7/users/adb1c41fbfb942f78c2286bb608b7be5/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:29.025495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.026042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.026555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.061100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] MFA Rules not processed for user `adb1c41fbfb942f78c2286bb608b7be5`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:29.063025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:29.150622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1101/2190] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:29 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:29.155531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.232174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d548a-9dff-4d72-8d6b-7d16544f51d5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.237441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.238102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.238577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.239236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.242902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.244874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.276839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1090/2191] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:29 2021] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:29.280678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.292352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da0d8-35d8-45e6-bd63-3931f894d951 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.357485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.358584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.358584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.358818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.360271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.362268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.391150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1102/2192] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:29 2021] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:29.396709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.407672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2aae-8a53-47c4-bf50-7fc6390558ee admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.413335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69aa5-60a8-46e8-82c0-46e8e0b2ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.413992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69aa5-60a8-46e8-82c0-46e8e0b2ec92 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.414302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69aa5-60a8-46e8-82c0-46e8e0b2ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.414577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69aa5-60a8-46e8-82c0-46e8e0b2ec92 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.415342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69aa5-60a8-46e8-82c0-46e8e0b2ec92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.417117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69aa5-60a8-46e8-82c0-46e8e0b2ec92 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.439650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1091/2193] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:29 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:29.443805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.453870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093a339-d14b-4df3-a9d2-a8e6fdc4657e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.459321 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.460115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.460400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.460674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] PATH_INFO: `/v3/projects/90fa702bc0a34c10b65b83c9744b0e1c/users/32e26027f9ce477da8f4e5ec531f550c/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.464026 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.464313 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.464586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.478478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fa702bc0a34c10b65b83c9744b0e1c, user_id=32e26027f9ce477da8f4e5ec531f550c, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.481382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.496471 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1103/2194] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:29 2021] PUT /identity/v3/projects/90fa702bc0a34c10b65b83c9744b0e1c/users/32e26027f9ce477da8f4e5ec531f550c/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:29.500472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.521847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:29.523157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:29.568914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8027a-93f9-4e12-85e3-2ce2ecfdcfff admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.574533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.574533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.574868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.575232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.576087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.577750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.588124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1104/2195] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:29 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:29.592636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.595445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1092/2196] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:44:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:29.606026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084bff7-69ad-4c72-90d0-9e9b33f9ea06 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.609064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.611025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:29.613042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2bf56-e55a-4ee0-bd4f-8f1b48d95988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.614434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2bf56-e55a-4ee0-bd4f-8f1b48d95988 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.614609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2bf56-e55a-4ee0-bd4f-8f1b48d95988 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.615533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2bf56-e55a-4ee0-bd4f-8f1b48d95988 admin admin] PATH_INFO: `/v3/projects/90fa702bc0a34c10b65b83c9744b0e1c/users/32e26027f9ce477da8f4e5ec531f550c/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.617254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2bf56-e55a-4ee0-bd4f-8f1b48d95988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fa702bc0a34c10b65b83c9744b0e1c, user_id=32e26027f9ce477da8f4e5ec531f550c, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.620195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2bf56-e55a-4ee0-bd4f-8f1b48d95988 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.634071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1105/2197] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:29 2021] PUT /identity/v3/projects/90fa702bc0a34c10b65b83c9744b0e1c/users/32e26027f9ce477da8f4e5ec531f550c/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:29.644820 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.645102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.645381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.673824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] MFA Rules not processed for user `32e26027f9ce477da8f4e5ec531f550c`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:29.674851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:29.707417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f155bc-5f99-45e4-a29e-bd80b5a04dfc None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.761014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1106/2198] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:29 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:29.771763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:29.773978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:29.775037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.775768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.776187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.776580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.868964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.870338 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:29.883251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1093/2199] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:44:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 08:44:29.920912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46cf8f-73f2-4c4d-9394-1922e4549afe None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:29.926299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:29.927398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:29.927685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:29.928010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:29.964133 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:29.972783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.004488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1107/2200] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:29 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:30.127309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.141157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ec379-b104-4542-87ac-3f5a3ea85c02 service swift] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:30.149879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:30.153393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:30.153779 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:30.154160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:30.256751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:30.259468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:30.270764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1094/2201] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:30 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:30.916868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:30.918738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:30.998038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3946e-1193-475b-bc47-8160dffc1422 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.002923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.003829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.004110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.004386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] PATH_INFO: `/v3/users/187c1ecfe6774670b1581e9c52e7aa79` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.005548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187c1ecfe6774670b1581e9c52e7aa79)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.007504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.054273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187c1ecfe6774670b1581e9c52e7aa79'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.061025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187c1ecfe6774670b1581e9c52e7aa79'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.061701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187c1ecfe6774670b1581e9c52e7aa79'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.073444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187c1ecfe6774670b1581e9c52e7aa79'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.081223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ad7ef364-527c-4d71-a01f-030766107d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187c1ecfe6774670b1581e9c52e7aa79'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.087005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1108/2202] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:30 2021] DELETE /identity/v3/users/187c1ecfe6774670b1581e9c52e7aa79 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:31.275399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.287203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2615de2-94c5-45c1-803b-2ee974371493 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.371621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.372490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.372987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.373690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] PATH_INFO: `/v3/projects/73c780e58c4f4b9ebb34c8763c298d8b` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.375391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c780e58c4f4b9ebb34c8763c298d8b)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.379468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.440443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c780e58c4f4b9ebb34c8763c298d8b', 'request_id': 'req-aeb7797c-df75-444d-9a17-7476dc63837f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.446487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c780e58c4f4b9ebb34c8763c298d8b', 'request_id': 'req-aeb7797c-df75-444d-9a17-7476dc63837f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.457291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c780e58c4f4b9ebb34c8763c298d8b', 'request_id': 'req-aeb7797c-df75-444d-9a17-7476dc63837f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.469412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] The token cache is being invalidate because project 73c780e58c4f4b9ebb34c8763c298d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:31.469723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.470468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-aeb7797c-df75-444d-9a17-7476dc63837f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:31.471955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1095/2203] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:31 2021] DELETE /identity/v3/projects/73c780e58c4f4b9ebb34c8763c298d8b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:31.477894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.478220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.478504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.495616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:31.496796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:31.561648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1109/2204] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:31.570483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.570897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.571317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.592655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:31.594624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:31.602948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1096/2205] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:31.607119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.616497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fee105-8ec5-4326-9b65-24373069a8ce None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.620788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.621441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.621730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.622010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.622736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:31.623079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.625054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.636587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1110/2206] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:31.641421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.649968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297d0bb-bc5b-49a8-ad83-c2eee3836463 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.654437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.655194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.655482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.655760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.657283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.659261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.683578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1097/2207] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:31 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:44:31.687996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.697451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77add666-af20-471c-8247-4842e5ec3634 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.750050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.750738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.751063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.751378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.752043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.753946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.774344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1111/2208] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:31 2021] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:31.778470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.788669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b3e2-1330-4a2d-b94b-ccdea4949466 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.792989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.793649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.793930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.794205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.794940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.796551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.808461 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1098/2209] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:31.812987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.834307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc1514-0fe1-4b57-afa7-a8949b8853ae admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.841886 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e50bc-c220-40e7-baa9-c0bf7c8461d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.842572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e50bc-c220-40e7-baa9-c0bf7c8461d9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.842858 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e50bc-c220-40e7-baa9-c0bf7c8461d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.843171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e50bc-c220-40e7-baa9-c0bf7c8461d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.846047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e50bc-c220-40e7-baa9-c0bf7c8461d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.847363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e50bc-c220-40e7-baa9-c0bf7c8461d9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.859786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1112/2210] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:31.863660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:31.874209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aef8a9-831e-46c7-9db1-39be62617940 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:31.881141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:31.882302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.882813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.883262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] PATH_INFO: `/v3/projects/d44a2c55fed34017a194772dd4f964a6/users/a3c33eec38a1409dba4a76f365866691/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.901532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44a2c55fed34017a194772dd4f964a6, user_id=a3c33eec38a1409dba4a76f365866691, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:31.904393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:31.919894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1099/2211] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:31 2021] PUT /identity/v3/projects/d44a2c55fed34017a194772dd4f964a6/users/a3c33eec38a1409dba4a76f365866691/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:31.932095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:31.932691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:31.932691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:31.961309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] MFA Rules not processed for user `a3c33eec38a1409dba4a76f365866691`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:31.962436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:32.038868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1113/2212] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:31 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:32.049167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:32.051114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:32.140302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e331a5-b4c7-4008-89bd-18dddc0bc3a5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:32.146959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89909418-5c29-48a0-9d88-cba46bc707ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:32.147712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909418-5c29-48a0-9d88-cba46bc707ca service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:32.148092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909418-5c29-48a0-9d88-cba46bc707ca service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:32.148478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909418-5c29-48a0-9d88-cba46bc707ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:32.158239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89909418-5c29-48a0-9d88-cba46bc707ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:32.160386 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89909418-5c29-48a0-9d88-cba46bc707ca service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:32.173206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1100/2213] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:32 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:38.560122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:38.561475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:38.622014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1584c2e-e2b8-451b-8c9b-a3845e10b326 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:38.627766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:38.628642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:38.628929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:38.629210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] PATH_INFO: `/v3/users/adb1c41fbfb942f78c2286bb608b7be5` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:38.630398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb1c41fbfb942f78c2286bb608b7be5)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:38.632381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:38.706750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb1c41fbfb942f78c2286bb608b7be5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:38.728597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb1c41fbfb942f78c2286bb608b7be5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:38.729329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb1c41fbfb942f78c2286bb608b7be5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:38.742252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb1c41fbfb942f78c2286bb608b7be5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:38.753270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb1c41fbfb942f78c2286bb608b7be5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:38.761470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1114/2214] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:38 2021] DELETE /identity/v3/users/adb1c41fbfb942f78c2286bb608b7be5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:38.766900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:38.767618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:38.767884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:38.795805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:38.797014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:38.855732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1101/2215] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:38.866388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:38.868071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:38.933614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff3c78-6316-4dee-9e64-f850d515af10 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:38.957155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:38.957155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:38.957155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:38.957155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:38.966106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:38.967598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:38.982114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1115/2216] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:39.271548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.273151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:39.300697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30c119-43b2-4bbc-9751-d4d82be45bd1 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.305718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.306596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.306881 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.307189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] PATH_INFO: `/v3/projects/20a521c7e85e4a36b2cc981b791cc0a7` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.308513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a521c7e85e4a36b2cc981b791cc0a7)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.310433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.368518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a521c7e85e4a36b2cc981b791cc0a7', 'request_id': 'req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.374245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a521c7e85e4a36b2cc981b791cc0a7', 'request_id': 'req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.382479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a521c7e85e4a36b2cc981b791cc0a7', 'request_id': 'req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.394312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] The token cache is being invalidate because project 20a521c7e85e4a36b2cc981b791cc0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:39.394599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.395256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.396796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1102/2217] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:39 2021] DELETE /identity/v3/projects/20a521c7e85e4a36b2cc981b791cc0a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:39.400869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.410447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f0d6e-228f-4368-ad92-0da7b15d0075 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:39.470681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:39.471589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:39.471870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:39.472148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] PATH_INFO: `/v3/users/32e26027f9ce477da8f4e5ec531f550c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:39.473348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e26027f9ce477da8f4e5ec531f550c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:39.475305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:39.526097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e26027f9ce477da8f4e5ec531f550c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.532739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e26027f9ce477da8f4e5ec531f550c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.533406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e26027f9ce477da8f4e5ec531f550c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.544610 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e26027f9ce477da8f4e5ec531f550c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.552311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8bc3b9fc-9b83-4142-a950-d5498bea20a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e26027f9ce477da8f4e5ec531f550c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:39.558217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1116/2218] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:39 2021] DELETE /identity/v3/users/32e26027f9ce477da8f4e5ec531f550c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:39.927474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:39.931080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:39.947857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1aee4-d9ed-4582-a78c-e8fdf7c7fea7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.014859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.015863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.016812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.017331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] PATH_INFO: `/v3/projects/90fa702bc0a34c10b65b83c9744b0e1c` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.018577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fa702bc0a34c10b65b83c9744b0e1c)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.020687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.087047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fa702bc0a34c10b65b83c9744b0e1c', 'request_id': 'req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.092352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fa702bc0a34c10b65b83c9744b0e1c', 'request_id': 'req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.101088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fa702bc0a34c10b65b83c9744b0e1c', 'request_id': 'req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.112419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] The token cache is being invalidate because project 90fa702bc0a34c10b65b83c9744b0e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:40.112901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.113803 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1548a9a1-940e-424c-ad28-7a6cdf0e71ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.115928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1103/2219] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:39 2021] DELETE /identity/v3/projects/90fa702bc0a34c10b65b83c9744b0e1c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:40.121666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.122188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.122295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.140381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:40.142585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.201922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1117/2220] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:40.209889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.210176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.210456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.237002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:40.238189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.246787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1104/2221] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:40.251824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.260798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4207c-8705-4c41-af19-8492a834ec9a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.265304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.266579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.266878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.267207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.268000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:40.268313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.269945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.298933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1118/2222] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:44:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:40.303038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.312431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f739ca-e434-4e23-a052-084c24fddf88 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.317796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.318559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.318741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.319046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.319739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.321659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.360281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1105/2223] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:40.364335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.374080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ba4d-dc1a-4cc8-84a3-349153f95641 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.429704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.430360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.430643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.430944 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.431620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.433536 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.452459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1119/2224] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:40.456555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.465830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c393188-1a4b-438e-a493-76aa007c6c2b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.470115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.470755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.471082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.471354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.472071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.473669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.484472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1106/2225] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:40 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:40.488762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.498437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c97b-5807-4a62-9428-81e52a582f61 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.503893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c15ded-b9be-45b0-9363-ced46d9642aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.504428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15ded-b9be-45b0-9363-ced46d9642aa admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.504714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15ded-b9be-45b0-9363-ced46d9642aa admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.505092 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c15ded-b9be-45b0-9363-ced46d9642aa admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.505690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c15ded-b9be-45b0-9363-ced46d9642aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.507384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c15ded-b9be-45b0-9363-ced46d9642aa admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.518323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1120/2226] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:40.522488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.531732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2194-607d-4d46-8f41-907745fedfdc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.536733 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.537616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.537901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.538175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] PATH_INFO: `/v3/projects/508d54b07f08428b8b0e6c4036389283/users/f897df2bd80543628150cb78d6940083/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.557455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d54b07f08428b8b0e6c4036389283, user_id=f897df2bd80543628150cb78d6940083, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.560330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.586363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1107/2227] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:40 2021] PUT /identity/v3/projects/508d54b07f08428b8b0e6c4036389283/users/f897df2bd80543628150cb78d6940083/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:40.597903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.598228 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.598480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.629402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] MFA Rules not processed for user `f897df2bd80543628150cb78d6940083`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:40.630486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.642153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.647566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.697957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1121/2228] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:40.702479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.740439 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7e34-3059-4833-8208-36cdb8ef59da admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.744890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.745764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.746049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.746365 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] PATH_INFO: `/v3/users/a3c33eec38a1409dba4a76f365866691` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.747624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c33eec38a1409dba4a76f365866691)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.749832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.765240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8d0e0-0947-41a4-93e9-9bf7bdec1eca None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.769627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.770381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.770571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.770847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.771594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.773508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.798361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c33eec38a1409dba4a76f365866691'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.799060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c33eec38a1409dba4a76f365866691'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.804207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1122/2229] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:40.805158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.805752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c33eec38a1409dba4a76f365866691'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.806729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.813661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c33eec38a1409dba4a76f365866691'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.814421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f72e9296-79a7-4fda-b26c-b87bc24a2c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c33eec38a1409dba4a76f365866691'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:40.831694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1108/2230] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:40 2021] DELETE /identity/v3/users/a3c33eec38a1409dba4a76f365866691 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:40.836079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.836357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.836658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.852948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:40.854330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.870093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3b083-4b07-4fc4-abc5-aa82372b0336 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.919354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1109/2231] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:40.931336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.932732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:40.945842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.946571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.946851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:40.947164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:40.947864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:40.959798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:40.996034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1123/2232] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:40 2021] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:40.996270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cf46-6846-4b0b-84b3-fd42bc82266e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:40.997114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:40.997942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:40.999426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:40.999814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.000187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.007837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591239-14bf-490c-adda-5439bf578ad6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.010882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.012537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.012659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.013221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.013511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.013789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.014670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.016433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.022826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1110/2233] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:41.026950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1124/2234] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:41.030793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.040829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba4ba-9db1-4841-8d75-dae525aa256e service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.045281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.046165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.046447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.046724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] PATH_INFO: `/v3/projects/da1386c6028a44f1b0d3f947b49dac2d/users/2b869b3dc68f4732b12539b87ddadde0/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.063452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1386c6028a44f1b0d3f947b49dac2d, user_id=2b869b3dc68f4732b12539b87ddadde0, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.066135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.081892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1111/2235] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:41 2021] PUT /identity/v3/projects/da1386c6028a44f1b0d3f947b49dac2d/users/2b869b3dc68f4732b12539b87ddadde0/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:41.085837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.096847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fc54c-0627-427f-ae77-416556ff87b5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.164987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfae25-fe7e-40c1-b169-0e36eb0e6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.166866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfae25-fe7e-40c1-b169-0e36eb0e6de7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.166866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfae25-fe7e-40c1-b169-0e36eb0e6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.166866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfae25-fe7e-40c1-b169-0e36eb0e6de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.166866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfae25-fe7e-40c1-b169-0e36eb0e6de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.168868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfae25-fe7e-40c1-b169-0e36eb0e6de7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.180652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1125/2236] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:41 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:41.197964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.210533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb3b2-1fea-448f-9bdc-9d37b4884fa1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.215096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.217830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.217830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.217830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] PATH_INFO: `/v3/projects/da1386c6028a44f1b0d3f947b49dac2d/users/2b869b3dc68f4732b12539b87ddadde0/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.218329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1386c6028a44f1b0d3f947b49dac2d, user_id=2b869b3dc68f4732b12539b87ddadde0, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.221993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.234581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1112/2237] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:41 2021] PUT /identity/v3/projects/da1386c6028a44f1b0d3f947b49dac2d/users/2b869b3dc68f4732b12539b87ddadde0/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:41.245572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.245860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.246142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.276643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] MFA Rules not processed for user `2b869b3dc68f4732b12539b87ddadde0`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:41.278895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.350286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1126/2238] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:41 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:41.361793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.363604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.420257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d384f1-f4a5-4174-9ab4-4f26f4521bd6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.425900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.426570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.427077 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.427367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.437061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.439806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.450501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1113/2239] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:41 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:41.484446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.485848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.520294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.524198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.549419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75990be-abf6-4a07-ad2a-b104b7aec84e service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.553897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.554851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.555242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.555592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.557653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.607397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253e1fd-8d24-4a6c-bd64-a6811047dbf5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.613599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.615308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.615598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.615876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] PATH_INFO: `/v3/projects/d44a2c55fed34017a194772dd4f964a6` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.617032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44a2c55fed34017a194772dd4f964a6)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.619002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.622025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.623784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa72a2-ac8b-4f5f-8087-6ddc2107779c service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.633009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1114/2240] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:41 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:41.676660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44a2c55fed34017a194772dd4f964a6', 'request_id': 'req-022c38e3-8820-4660-a696-68bf3d14f9d6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.681996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44a2c55fed34017a194772dd4f964a6', 'request_id': 'req-022c38e3-8820-4660-a696-68bf3d14f9d6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.692483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44a2c55fed34017a194772dd4f964a6', 'request_id': 'req-022c38e3-8820-4660-a696-68bf3d14f9d6'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.718540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] The token cache is being invalidate because project d44a2c55fed34017a194772dd4f964a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:41.718890 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.719612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.721485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1127/2241] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:41 2021] DELETE /identity/v3/projects/d44a2c55fed34017a194772dd4f964a6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:41.727529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640bfb8-f0a1-4d85-8469-61e573b01134 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.727821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640bfb8-f0a1-4d85-8469-61e573b01134 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.728102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640bfb8-f0a1-4d85-8469-61e573b01134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.755432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-0640bfb8-f0a1-4d85-8469-61e573b01134 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:41.760696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-0640bfb8-f0a1-4d85-8469-61e573b01134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.793765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.795374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.833959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1115/2242] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:41.841634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.841944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.842219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.863209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:41.864415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:41.872013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1116/2243] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:41.875015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c38e3-8820-4660-a696-68bf3d14f9d6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.877275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.880363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.881233 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.881524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.881797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] PATH_INFO: `/v3/users/f897df2bd80543628150cb78d6940083` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.883000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f897df2bd80543628150cb78d6940083)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.884948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.887240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd783-1cd4-4e54-9cbd-7f3e75c6b68e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.897104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.897854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.898162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.898438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.899476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:41.899882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.901776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.930898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1117/2244] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:44:41.935195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:41.948787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5431213-52ea-4455-9fa2-2e251fa2fe85 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:41.954480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:41.955664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:41.956085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:41.956217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f897df2bd80543628150cb78d6940083'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.956498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:41.957469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:41.963726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f897df2bd80543628150cb78d6940083'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.964616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f897df2bd80543628150cb78d6940083'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.970588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:41.977746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f897df2bd80543628150cb78d6940083'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.988027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6bbeab14-de75-419f-a77e-e230ec658e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f897df2bd80543628150cb78d6940083'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:41.999070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1128/2245] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:41 2021] DELETE /identity/v3/users/f897df2bd80543628150cb78d6940083 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:42.006558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.007495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.008230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.013181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1118/2246] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:41 2021] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:42.016045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.022157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.039198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:42.040421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.095288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdab02-146a-41bd-a864-671c9e2394bb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.099773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.100121 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1129/2247] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:42.100478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.100764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.101042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.101735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.104168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.109955 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.111429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.123663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1119/2248] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:42 2021] POST /identity/v3/users => generated 278 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:42.127694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.136728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ecee6-cc4a-4435-a7db-f852452c7b7c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.141797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.142449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.142736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.143070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.143818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.145508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.155440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1120/2249] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:42.159815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.168686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de923-ca7d-4402-a3c4-2d225e997318 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.168996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1cd7-3e3d-4564-9f87-e9b32da6dd0b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.172482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b50789-6400-4481-ac42-cec36fa8a7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.173096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.173223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50789-6400-4481-ac42-cec36fa8a7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.173377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50789-6400-4481-ac42-cec36fa8a7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.173648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50789-6400-4481-ac42-cec36fa8a7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.173744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.174007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.174292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.175030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.176646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.182604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b50789-6400-4481-ac42-cec36fa8a7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.184098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b50789-6400-4481-ac42-cec36fa8a7b2 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.186300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1121/2250] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:42.190644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.193616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1130/2251] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:42.200672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b01e8-738b-45bf-8438-8940a862fc48 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.207214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.208230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.208519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.208902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] PATH_INFO: `/v3/projects/2ce93f8e88754b8e93a31b2b63fd46f1/users/2f7ba82705bc41fbb9cd30468ef02b1e/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.230230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce93f8e88754b8e93a31b2b63fd46f1, user_id=2f7ba82705bc41fbb9cd30468ef02b1e, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.234813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.267508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1122/2252] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:42 2021] PUT /identity/v3/projects/2ce93f8e88754b8e93a31b2b63fd46f1/users/2f7ba82705bc41fbb9cd30468ef02b1e/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:42.268811 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.269100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.269364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.299313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] MFA Rules not processed for user `2f7ba82705bc41fbb9cd30468ef02b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:42.300971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.380357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.382277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1131/2253] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:42 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:42.442762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30acd5-b48b-472f-80d8-663797eaba9f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.447162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.447814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.448103 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.448377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.449053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.450981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.485250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1123/2254] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:42 2021] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:42.489229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.499806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5715a4-913b-4bf2-a1c7-928ae5a751b2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.520556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.522452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.571864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.573180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.573486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.574143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.575013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.581308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.608518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cf36-99f9-4885-8479-d881f7b053a7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.611519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1132/2255] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:42 2021] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:42.615209 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.616258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.617304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.617745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.618169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] PATH_INFO: `/v3/projects/508d54b07f08428b8b0e6c4036389283` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.619507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508d54b07f08428b8b0e6c4036389283)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.621833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.625947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec5be-9321-41a3-b079-7e06ba6843a8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.630958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.631633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.631918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.632206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.632948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.634669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.646582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1133/2256] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:42.650833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.663384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4ac98-386a-4a28-9f95-1cffffb7ba28 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.680755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.683437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.683437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.683437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] PATH_INFO: `/v3/projects/4a6fef273e1c45bf8fa491aaeab9e792/users/14fa03ae515b410a93e37a2f9eb6c4ed/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.684603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508d54b07f08428b8b0e6c4036389283', 'request_id': 'req-3ad434ae-1a80-45de-8c75-3a7c70c15076'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.693152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508d54b07f08428b8b0e6c4036389283', 'request_id': 'req-3ad434ae-1a80-45de-8c75-3a7c70c15076'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.704197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508d54b07f08428b8b0e6c4036389283', 'request_id': 'req-3ad434ae-1a80-45de-8c75-3a7c70c15076'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.704628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6fef273e1c45bf8fa491aaeab9e792, user_id=14fa03ae515b410a93e37a2f9eb6c4ed, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.708055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.730874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1134/2257] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:42 2021] PUT /identity/v3/projects/4a6fef273e1c45bf8fa491aaeab9e792/users/14fa03ae515b410a93e37a2f9eb6c4ed/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:42.731885 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.733583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] The token cache is being invalidate because project 508d54b07f08428b8b0e6c4036389283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:42.734391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.737737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.743142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1124/2258] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:42 2021] DELETE /identity/v3/projects/508d54b07f08428b8b0e6c4036389283 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:42.746754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.748721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.816759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6afd86-8cda-463d-b7fa-77a8d09bf72a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.821350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.822023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.822311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.822590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.823354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.825122 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.829856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad434ae-1a80-45de-8c75-3a7c70c15076 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.834777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.835961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.836383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.836800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] PATH_INFO: `/v3/users/2b869b3dc68f4732b12539b87ddadde0` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.838168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b869b3dc68f4732b12539b87ddadde0)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.842356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1135/2259] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:42.842519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.844452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:42.846196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:42.858147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2094ce-5088-4a26-86b8-0339381e74f3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:42.863948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd77eb1-e454-408c-a9bc-07334cb91b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:42.865056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd77eb1-e454-408c-a9bc-07334cb91b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.865460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd77eb1-e454-408c-a9bc-07334cb91b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.865771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd77eb1-e454-408c-a9bc-07334cb91b2a admin admin] PATH_INFO: `/v3/projects/4a6fef273e1c45bf8fa491aaeab9e792/users/14fa03ae515b410a93e37a2f9eb6c4ed/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.868865 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd77eb1-e454-408c-a9bc-07334cb91b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6fef273e1c45bf8fa491aaeab9e792, user_id=14fa03ae515b410a93e37a2f9eb6c4ed, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:42.874489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd77eb1-e454-408c-a9bc-07334cb91b2a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:42.887845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1136/2260] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:42 2021] PUT /identity/v3/projects/4a6fef273e1c45bf8fa491aaeab9e792/users/14fa03ae515b410a93e37a2f9eb6c4ed/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:44:42.889284 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b869b3dc68f4732b12539b87ddadde0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.889434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b869b3dc68f4732b12539b87ddadde0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.897143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b869b3dc68f4732b12539b87ddadde0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.899663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:42.899958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:42.900235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:42.905006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b869b3dc68f4732b12539b87ddadde0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.905971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b869b3dc68f4732b12539b87ddadde0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:42.924298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1125/2261] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:42 2021] DELETE /identity/v3/users/2b869b3dc68f4732b12539b87ddadde0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:42.927924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] MFA Rules not processed for user `14fa03ae515b410a93e37a2f9eb6c4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:42.929143 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.022341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1137/2262] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:42 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:43.027489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.029012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.136524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619e17-7149-49b8-99f6-552c86b54159 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.141893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.142557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.142840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.143140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.155606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.159758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.199679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1126/2263] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:43 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:43.311192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.325891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af136f-50ab-4e62-8348-103553e44ace None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.327060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.331248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.331351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.364205 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.364501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.364784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.366807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.413427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9939-de93-4d92-945d-05a8b0b42a92 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.419985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.420336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.420586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.420864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] PATH_INFO: `/v3/projects/da1386c6028a44f1b0d3f947b49dac2d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.422820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1386c6028a44f1b0d3f947b49dac2d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.425616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.456918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.459607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916f42d-7ee9-428b-9606-e304c51bf597 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.472861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1138/2264] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:43 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:43.493738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1386c6028a44f1b0d3f947b49dac2d', 'request_id': 'req-d3e91d79-90f8-4529-b42e-21d64484e6b4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:43.499918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1386c6028a44f1b0d3f947b49dac2d', 'request_id': 'req-d3e91d79-90f8-4529-b42e-21d64484e6b4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:43.510981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1386c6028a44f1b0d3f947b49dac2d', 'request_id': 'req-d3e91d79-90f8-4529-b42e-21d64484e6b4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:43.525490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] The token cache is being invalidate because project da1386c6028a44f1b0d3f947b49dac2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:43.525816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:43.526536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d3e91d79-90f8-4529-b42e-21d64484e6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:43.528361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1127/2265] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:43 2021] DELETE /identity/v3/projects/da1386c6028a44f1b0d3f947b49dac2d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:43.535497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.536029 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.536405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.558691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:43.559887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.635248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1139/2266] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:44:43.643786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.644078 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.644360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.664488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:43.665722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:43.673430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1128/2267] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:43.677881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.686775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862be6a-239c-43d9-bcaa-5ea751bb699b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.691468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.692211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.692495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.692873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.693577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:44:43.693879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.695843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.710183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1140/2268] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:44:43.714956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.724668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25eed-9520-482b-802a-f968d72edb8f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.729288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.729932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.730216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.730494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.731212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.733115 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.758060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1129/2269] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:43 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:44:43.762307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.772326 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4808-80f7-4ec3-acf1-9c65190da392 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.824281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.824941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.825220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.825492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.826174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.828105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.848388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1141/2270] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:43 2021] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:43.852326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.863023 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91fde-3e00-4dd9-bdc0-7123c2a6a03b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.867567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.868221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.868505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.868782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.869537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.871161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.882701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1130/2271] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:43.886805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.897107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5084b-8308-48e4-96ee-9f7f5ebee122 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.901500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64ecdd-d44a-4b95-bddf-de82620e8b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.902156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64ecdd-d44a-4b95-bddf-de82620e8b72 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.902438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64ecdd-d44a-4b95-bddf-de82620e8b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.902725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64ecdd-d44a-4b95-bddf-de82620e8b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.903473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64ecdd-d44a-4b95-bddf-de82620e8b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.905066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64ecdd-d44a-4b95-bddf-de82620e8b72 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.918020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1142/2272] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:43.919613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:43.929181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a2eb6-b7a3-4ad1-8fb3-e89e44869b81 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:43.933740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:43.934608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.934884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.935192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] PATH_INFO: `/v3/projects/c6d0a598be124dc78cf22f483c52c986/users/d84f444f3c96443cb762348707f33687/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.950766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d0a598be124dc78cf22f483c52c986, user_id=d84f444f3c96443cb762348707f33687, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:43.954034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:43.966658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1131/2273] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:43 2021] PUT /identity/v3/projects/c6d0a598be124dc78cf22f483c52c986/users/d84f444f3c96443cb762348707f33687/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:43.972229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f437a83-e0c2-45b1-bc83-470159009e2b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:43.972587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f437a83-e0c2-45b1-bc83-470159009e2b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:43.972926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f437a83-e0c2-45b1-bc83-470159009e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:43.990949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4f437a83-e0c2-45b1-bc83-470159009e2b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:43.992348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4f437a83-e0c2-45b1-bc83-470159009e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:44.054363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1143/2274] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:44.065010 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.066737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:44.124999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf88f-dbbb-4147-9b40-b2970c00a5da admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.129683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.130347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.130631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.131016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.140592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:44.143376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:44.153665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1132/2275] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:44.847604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.848152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.848152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:44.883512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] MFA Rules not processed for user `d84f444f3c96443cb762348707f33687`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:44.885023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:44.972961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1144/2276] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:44 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:44.978668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:44.993209 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534f03f-8d11-4001-b6f1-1b57e88f374d service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:44.998653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:44.998814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:44.999064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:44.999349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.000356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.002951 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.035773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1133/2277] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:44:44 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:45.036964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.057623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbdba9-6f91-48f5-89d9-3202492a2231 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.136473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.137332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.137627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.137898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.138774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.141561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.174165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1145/2278] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:44:45 2021] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:44:45.175908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.187201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d1961-d583-41fc-85f2-1ac4cf72082b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.192702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.193739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.194193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.194819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.195742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.197547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.216508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1134/2279] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:45 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:44:45.221877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.241525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb1169-a146-4a10-b0ac-ad27513b5958 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.248295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.249540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.249826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.250810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] PATH_INFO: `/v3/projects/b6b6c4b8ab544667a150278b7217f032/users/2c9825f775044324b372ac5b285bee6a/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.271319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b6c4b8ab544667a150278b7217f032, user_id=2c9825f775044324b372ac5b285bee6a, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.273963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.306665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1146/2280] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:45 2021] PUT /identity/v3/projects/b6b6c4b8ab544667a150278b7217f032/users/2c9825f775044324b372ac5b285bee6a/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:45.307913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.323392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827741b-87e8-451c-9525-aadd2b21a401 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.392729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b263e2-42cd-41c2-aa91-96ee7280fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.393412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b263e2-42cd-41c2-aa91-96ee7280fdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.393705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b263e2-42cd-41c2-aa91-96ee7280fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.393986 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b263e2-42cd-41c2-aa91-96ee7280fdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.394717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b263e2-42cd-41c2-aa91-96ee7280fdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.396360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b263e2-42cd-41c2-aa91-96ee7280fdd6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.407018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1135/2281] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:44:45 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:44:45.411311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:45.421735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac9d4a-3bef-4b57-8350-c0e633be1ad8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:45.428695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:45.429767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:45.430054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:45.430329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] PATH_INFO: `/v3/projects/b6b6c4b8ab544667a150278b7217f032/users/2c9825f775044324b372ac5b285bee6a/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:45.432752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b6c4b8ab544667a150278b7217f032, user_id=2c9825f775044324b372ac5b285bee6a, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:45.435487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:45.448507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1147/2282] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:44:45 2021] PUT /identity/v3/projects/b6b6c4b8ab544667a150278b7217f032/users/2c9825f775044324b372ac5b285bee6a/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:46.127628 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.127921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.128201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.191585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] MFA Rules not processed for user `2c9825f775044324b372ac5b285bee6a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:46.192781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:46.317293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1136/2283] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:46 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:46.331572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:46.333200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:46.395431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed1a4-eefc-42f5-b1bf-75adb2c3f28d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:46.398854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf64a0-8fa6-42b3-a478-7e5e226e6699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:46.399526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf64a0-8fa6-42b3-a478-7e5e226e6699 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:46.399814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf64a0-8fa6-42b3-a478-7e5e226e6699 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:46.400093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf64a0-8fa6-42b3-a478-7e5e226e6699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:46.455104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf64a0-8fa6-42b3-a478-7e5e226e6699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:46.456449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf64a0-8fa6-42b3-a478-7e5e226e6699 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:46.464903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1148/2284] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:44:47.866045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:47.868106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:47.881423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ecac-c757-4268-b780-18cef9b3675e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:47.885265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:47.885921 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:47.886202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:47.886472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:47.899385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:47.901287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:47.913293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1137/2285] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:47 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:52.148155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:52.149038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:52.149818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:52.169505 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:52.170991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:52.232198 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1149/2286] 10.222.0.66 () {58 vars in 968 bytes} [Tue Jul 13 08:44:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:52.251907 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:52.253297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:52.332596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d685254-10a0-4862-8666-27db9eaf823e service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:52.338109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfa700-69b2-4b7d-b6b3-9125d8996831 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:52.338988 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa700-69b2-4b7d-b6b3-9125d8996831 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:52.339455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa700-69b2-4b7d-b6b3-9125d8996831 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:52.340012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa700-69b2-4b7d-b6b3-9125d8996831 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:52.352075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfa700-69b2-4b7d-b6b3-9125d8996831 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:52.354819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfa700-69b2-4b7d-b6b3-9125d8996831 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:52.364890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1138/2287] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:44:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:44:58.457351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.459593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:58.545577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52d66e-f2f8-470c-b879-56d06e5b5d8e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.553463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.554346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.554671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.559967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] PATH_INFO: `/v3/users/2f7ba82705bc41fbb9cd30468ef02b1e` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.561441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7ba82705bc41fbb9cd30468ef02b1e)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.563511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.628514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7ba82705bc41fbb9cd30468ef02b1e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:58.635888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7ba82705bc41fbb9cd30468ef02b1e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:58.636656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7ba82705bc41fbb9cd30468ef02b1e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:58.652325 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7ba82705bc41fbb9cd30468ef02b1e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:58.661701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7ba82705bc41fbb9cd30468ef02b1e'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:58.668999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1150/2288] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:58 2021] DELETE /identity/v3/users/2f7ba82705bc41fbb9cd30468ef02b1e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:58.673671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.674319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.674319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.692478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:58.693730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:58.757583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1139/2289] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:44:58.767589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:58.769149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:58.827476 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48c136-8a63-4458-baac-ceb4829b12c5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:58.832150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:58.832891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:58.833355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:58.833692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:58.844656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:58.846194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:58.855812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1151/2290] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:44:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:44:59.163011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.164747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:59.179138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e8182-cf83-45c2-b57a-e8a396680bef None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.184897 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.185687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.185981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.186967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] PATH_INFO: `/v3/projects/2ce93f8e88754b8e93a31b2b63fd46f1` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.189423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce93f8e88754b8e93a31b2b63fd46f1)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.191497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.238889 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce93f8e88754b8e93a31b2b63fd46f1', 'request_id': 'req-7e676012-391c-499b-a86b-ef72d4da482a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.244462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce93f8e88754b8e93a31b2b63fd46f1', 'request_id': 'req-7e676012-391c-499b-a86b-ef72d4da482a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.252324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce93f8e88754b8e93a31b2b63fd46f1', 'request_id': 'req-7e676012-391c-499b-a86b-ef72d4da482a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.263537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] The token cache is being invalidate because project 2ce93f8e88754b8e93a31b2b63fd46f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:59.263825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.264451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.265965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1140/2291] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:59 2021] DELETE /identity/v3/projects/2ce93f8e88754b8e93a31b2b63fd46f1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:59.270517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.279626 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b9f69-ed22-45a7-b773-8978b8b27f68 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.332315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.333180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.333467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.333752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] PATH_INFO: `/v3/users/14fa03ae515b410a93e37a2f9eb6c4ed` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.334940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fa03ae515b410a93e37a2f9eb6c4ed)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.336894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.381164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fa03ae515b410a93e37a2f9eb6c4ed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.387621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fa03ae515b410a93e37a2f9eb6c4ed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.388277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fa03ae515b410a93e37a2f9eb6c4ed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.399927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fa03ae515b410a93e37a2f9eb6c4ed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.408283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-71776718-718a-4927-84bf-b0fafaaa1792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fa03ae515b410a93e37a2f9eb6c4ed'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.414000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1152/2292] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:44:59 2021] DELETE /identity/v3/users/14fa03ae515b410a93e37a2f9eb6c4ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:59.775706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:44:59.777091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:44:59.790512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e676012-391c-499b-a86b-ef72d4da482a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:44:59.870232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:44:59.871229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.871399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.872029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] PATH_INFO: `/v3/projects/4a6fef273e1c45bf8fa491aaeab9e792` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.873509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6fef273e1c45bf8fa491aaeab9e792)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:44:59.875469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:44:59.930930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6fef273e1c45bf8fa491aaeab9e792', 'request_id': 'req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.936309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6fef273e1c45bf8fa491aaeab9e792', 'request_id': 'req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.944937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6fef273e1c45bf8fa491aaeab9e792', 'request_id': 'req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.957211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] The token cache is being invalidate because project 4a6fef273e1c45bf8fa491aaeab9e792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:44:59.957506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.958151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d6dd8ed8-92c2-4755-9f4b-6cce40b4621b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:44:59.959713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1141/2293] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:44:59 2021] DELETE /identity/v3/projects/4a6fef273e1c45bf8fa491aaeab9e792 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:44:59.965734 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:44:59.966242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:44:59.966343 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:44:59.984146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:44:59.985942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:00.051759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1153/2294] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:44:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:00.057519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.057812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.058092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.081052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:00.082550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:00.089629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1142/2295] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:00.094193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.105740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd72529-27b6-45ba-a0e3-b0c7dae34f90 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.114603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.115701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.116163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.116623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.117878 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:00.118397 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.121401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.137200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1154/2296] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:00.143409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.152996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64077a3-75e3-4954-a1d3-82a0dc7ecdac None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.158371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.159079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.159357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.159626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.160325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.162434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.190128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1143/2297] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:00.195533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.206055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1fdb-1836-4545-8cf5-7a43ca33ef39 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.280733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.281451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.282737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.282737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.283953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.285983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.312298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1155/2298] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:00.313629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.325454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372ddf-50ab-43b0-bbe8-2732c15d24fd admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.330202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.330869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.331190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.331474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.332197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.333808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.346841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1144/2299] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:00.351004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.362108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acce01d-bf37-4673-ae33-df49e27f13eb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.367987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65ece-99e3-4252-8df8-b4aefc5bf198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.368742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65ece-99e3-4252-8df8-b4aefc5bf198 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.369100 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65ece-99e3-4252-8df8-b4aefc5bf198 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.369463 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65ece-99e3-4252-8df8-b4aefc5bf198 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.370262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65ece-99e3-4252-8df8-b4aefc5bf198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.371992 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65ece-99e3-4252-8df8-b4aefc5bf198 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.383701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1156/2300] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:00.387672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.405035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8c3c2-f259-4096-932c-f0f15ce51d03 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.410312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.411477 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.411935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.412451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] PATH_INFO: `/v3/projects/a18f8482694c4b33ab7f5d78eb6322e7/users/61881e51e4d14e4a8e90d9a386fd6a97/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.429392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18f8482694c4b33ab7f5d78eb6322e7, user_id=61881e51e4d14e4a8e90d9a386fd6a97, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.432132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.448323 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1145/2301] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:00 2021] PUT /identity/v3/projects/a18f8482694c4b33ab7f5d78eb6322e7/users/61881e51e4d14e4a8e90d9a386fd6a97/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:00.460052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.460388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.460704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.504066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] MFA Rules not processed for user `61881e51e4d14e4a8e90d9a386fd6a97`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:00.505255 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:00.578370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1157/2302] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:00.583752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.648004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e792a-2d4f-4fcb-8ed3-ee8ebe79fde3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.652495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.653152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.653440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.653716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.654423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.656373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.684100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1146/2303] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:00.690141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.701287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c793f55-df09-4bf6-b50e-4b69f6d27d5c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.768496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.769195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.769467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.769743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.770859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.772633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.795065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1158/2304] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:00.799462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.809734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda731-8a28-4931-ad1a-78a11043b2f1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.815375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.816317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.816657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.817000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.817958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.819797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.832562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1147/2305] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:00.837267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.854285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a05bf-147b-424c-81b9-d31268e59582 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.859497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c358-5c83-4fa4-8b5d-3469aefaec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.861030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c358-5c83-4fa4-8b5d-3469aefaec19 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.861421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c358-5c83-4fa4-8b5d-3469aefaec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.861648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c358-5c83-4fa4-8b5d-3469aefaec19 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.862377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c358-5c83-4fa4-8b5d-3469aefaec19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.864060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c358-5c83-4fa4-8b5d-3469aefaec19 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.877411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1159/2306] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:00.886238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:00.897535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530a960-b9d0-4657-a9ef-8286edb4f92b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:00.902755 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:00.903728 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.904012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.904592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] PATH_INFO: `/v3/projects/7642be9015d746368949137ab28ee02a/users/17593ca7eede44308a66a3d46d30a5af/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.925257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7642be9015d746368949137ab28ee02a, user_id=17593ca7eede44308a66a3d46d30a5af, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:00.929987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:00.948810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1148/2307] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:00 2021] PUT /identity/v3/projects/7642be9015d746368949137ab28ee02a/users/17593ca7eede44308a66a3d46d30a5af/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:00.958591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:00.959014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:00.959335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:00.997393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] MFA Rules not processed for user `17593ca7eede44308a66a3d46d30a5af`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:00.998844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.081021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1160/2308] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:00 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:01.085475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.156571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8d10a-d450-4eae-8dfb-65af6d19658b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.161812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.162496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.162777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.163111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.163810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.165747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.191374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1149/2309] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:01 2021] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:01.195427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.205830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d898b6-7815-45aa-b92b-1960504d19ce None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.275145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.275821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.276108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.276389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.277129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.279171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.300093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.301895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.306517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1161/2310] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:01 2021] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:01.310843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.318244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c24b1-e284-435f-9218-3f7b5bbb19de admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.322308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05fd2e-c98a-4a3f-a543-13a8533f6a5f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.322967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.323860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.324114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.324383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] PATH_INFO: `/v3/users/d84f444f3c96443cb762348707f33687` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.325522 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84f444f3c96443cb762348707f33687)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.327620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.328095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.328963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.329478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.329887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.330962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.332894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.343763 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1162/2311] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:01.350356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.359842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af836aa-8679-40e2-ba58-b203de677329 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.365814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.366866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.367222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.367519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] PATH_INFO: `/v3/projects/446bd0632bf841a1b595e45e30567999/users/3e518f61080e4e818353e8eb7ce9efde/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.382274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84f444f3c96443cb762348707f33687'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.383091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84f444f3c96443cb762348707f33687'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.383581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446bd0632bf841a1b595e45e30567999, user_id=3e518f61080e4e818353e8eb7ce9efde, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.386413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.390412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84f444f3c96443cb762348707f33687'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.399457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84f444f3c96443cb762348707f33687'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.400293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84f444f3c96443cb762348707f33687'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.401746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1163/2312] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:01 2021] PUT /identity/v3/projects/446bd0632bf841a1b595e45e30567999/users/3e518f61080e4e818353e8eb7ce9efde/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:01.405749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.408433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.421369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1150/2313] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:01 2021] DELETE /identity/v3/users/d84f444f3c96443cb762348707f33687 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:01.477836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46d9f-762e-4349-aee1-2a3595a0de58 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.539196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e5136-c733-4def-b522-b300c719686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.539868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5136-c733-4def-b522-b300c719686e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.540155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5136-c733-4def-b522-b300c719686e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.540432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5136-c733-4def-b522-b300c719686e admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.541155 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e5136-c733-4def-b522-b300c719686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.542757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e5136-c733-4def-b522-b300c719686e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.552839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1164/2314] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:01 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:01.556961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.566870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef97a4-cb09-4dd4-a376-2dc85615f6d4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.571557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.572512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.572898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.573240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] PATH_INFO: `/v3/projects/446bd0632bf841a1b595e45e30567999/users/3e518f61080e4e818353e8eb7ce9efde/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.575216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446bd0632bf841a1b595e45e30567999, user_id=3e518f61080e4e818353e8eb7ce9efde, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.578066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.611085 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1151/2315] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:01 2021] PUT /identity/v3/projects/446bd0632bf841a1b595e45e30567999/users/3e518f61080e4e818353e8eb7ce9efde/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:01.613259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.613553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.613942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.623640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.626814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.654532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] MFA Rules not processed for user `3e518f61080e4e818353e8eb7ce9efde`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:01.656637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.711570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfd5d-4b7b-4dd1-98cb-3c091492cda7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.716312 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.717257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.717610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.717895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] PATH_INFO: `/v3/projects/c6d0a598be124dc78cf22f483c52c986` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.719073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d0a598be124dc78cf22f483c52c986)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.721693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.742406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1165/2316] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:01 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:01.753487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.754774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.771725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d0a598be124dc78cf22f483c52c986', 'request_id': 'req-f7befc4d-9878-46c4-833c-faa2716742a0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.778657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d0a598be124dc78cf22f483c52c986', 'request_id': 'req-f7befc4d-9878-46c4-833c-faa2716742a0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.787229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d0a598be124dc78cf22f483c52c986', 'request_id': 'req-f7befc4d-9878-46c4-833c-faa2716742a0'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.798451 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] The token cache is being invalidate because project c6d0a598be124dc78cf22f483c52c986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:01.798757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.799453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.801113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1152/2317] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:01 2021] DELETE /identity/v3/projects/c6d0a598be124dc78cf22f483c52c986 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:01.804966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:01.806197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.812011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57b2a-3936-4ff6-ae9f-4f97425d1210 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.860197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.860832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.861181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.861390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.863188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:01.866325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7befc4d-9878-46c4-833c-faa2716742a0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:01.870773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:01.871666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:01.871944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:01.872212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] PATH_INFO: `/v3/users/2c9825f775044324b372ac5b285bee6a` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:01.873613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9825f775044324b372ac5b285bee6a)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.875563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.926466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9825f775044324b372ac5b285bee6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.927188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9825f775044324b372ac5b285bee6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.928293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:01.929356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:01.934437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9825f775044324b372ac5b285bee6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.940195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1166/2318] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:01 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:01.943570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9825f775044324b372ac5b285bee6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.944279 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-41c9431b-4b7a-4997-a912-608796984c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9825f775044324b372ac5b285bee6a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:01.962890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1153/2319] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:01 2021] DELETE /identity/v3/users/2c9825f775044324b372ac5b285bee6a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:02.165710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.183288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2a85e-db1c-4512-beac-c5ec8a4277a0 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.255999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.257128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.257496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.258034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] PATH_INFO: `/v3/projects/b6b6c4b8ab544667a150278b7217f032` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.259695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b6c4b8ab544667a150278b7217f032)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.262014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.319574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b6c4b8ab544667a150278b7217f032', 'request_id': 'req-b06b6796-ac52-4193-8d33-8ed7bf717841'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:02.327792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b6c4b8ab544667a150278b7217f032', 'request_id': 'req-b06b6796-ac52-4193-8d33-8ed7bf717841'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:02.336631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b6c4b8ab544667a150278b7217f032', 'request_id': 'req-b06b6796-ac52-4193-8d33-8ed7bf717841'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:02.349649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] The token cache is being invalidate because project b6b6c4b8ab544667a150278b7217f032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:02.350025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:02.354948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-b06b6796-ac52-4193-8d33-8ed7bf717841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:02.364366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1167/2320] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:02 2021] DELETE /identity/v3/projects/b6b6c4b8ab544667a150278b7217f032 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:02.369736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.370135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.370415 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.388516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:02.390021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:02.447638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1154/2321] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:02.456185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.456556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.456906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.478044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:02.479222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:02.480920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.482480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:02.486830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1168/2322] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:02.492979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.499714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1dfb-c4c6-4466-a4da-83bd3e47f320 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.504723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.505368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.505647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.505917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.506620 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:02.506958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.508535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.520376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1169/2323] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:45:02.524690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.533394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208e4a8-00cd-4605-b32d-18180b70ea64 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.537643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.538278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.538560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.538793 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8436bb-6300-4df6-b989-a0f988efeb0d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.538937 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.539532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.541400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.542314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.543080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.543261 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.543564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.545283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:02.567028 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1170/2324] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:02 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:02.571340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.602070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.603550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.612442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1155/2325] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:02 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:02.629509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f7038-ae0b-4752-ac55-f127b1c93909 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.633931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.634681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.634880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.635192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.635874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.637788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.660103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1171/2326] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:02 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:02.663965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.674976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2ea3-9317-494d-bd0b-80e542b6f04e service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.679633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.680410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.680788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.681238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.682049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.683804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.693758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1156/2327] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:02.697930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.707384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d56eb-8b4b-49f3-836c-f9548ca0b2a2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.711810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e276f36-7abd-48f3-993c-5cc9c0d73d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.712507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276f36-7abd-48f3-993c-5cc9c0d73d5c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.712792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276f36-7abd-48f3-993c-5cc9c0d73d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.713069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276f36-7abd-48f3-993c-5cc9c0d73d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.713783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e276f36-7abd-48f3-993c-5cc9c0d73d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.715420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e276f36-7abd-48f3-993c-5cc9c0d73d5c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.726428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1172/2328] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:02.730874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.741200 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5cbf7-2f81-494c-84e3-f7e83727d5e2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.746080 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.747144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.747706 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.747995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] PATH_INFO: `/v3/projects/9345a990fc7d469ebe56b001681cb930/users/c03b4fc33b8a44fd911b540fe5ab2b35/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.763935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9345a990fc7d469ebe56b001681cb930, user_id=c03b4fc33b8a44fd911b540fe5ab2b35, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.767600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:02.781178 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1157/2329] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:02 2021] PUT /identity/v3/projects/9345a990fc7d469ebe56b001681cb930/users/c03b4fc33b8a44fd911b540fe5ab2b35/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:02.792125 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.792494 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.792773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.819965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] MFA Rules not processed for user `c03b4fc33b8a44fd911b540fe5ab2b35`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:02.821291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:02.893791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1173/2330] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:02 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:02.898896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:02.962967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71eef7-b5b3-424d-9d55-3f91ada6c8af admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:02.967474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:02.968132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:02.968416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:02.968694 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:02.969453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:02.971998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.000433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1158/2331] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:02 2021] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:03.003665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:03.014044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cd8f0-5375-4b57-a106-e9c82b7ed28d None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:03.072867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:03.073520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.073814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.074091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.074783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:03.076808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.096169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1174/2332] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:03 2021] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:03.100127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:03.111121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723d5b-15b8-4901-b1ab-8a5c1e224ded admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:03.115970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:03.116711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.117059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.117401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.118120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:03.119998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.131700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1159/2333] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:03.136023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:03.145354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7bfa1-1c79-45d8-be08-feb9c60ee765 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:03.150336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:03.151437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.151756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.152031 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] PATH_INFO: `/v3/projects/f894ddf21ab34952a4ce25c5c8e57809/users/bbd480dcc51e4433b8894e4280a06f96/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.167366 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f894ddf21ab34952a4ce25c5c8e57809, user_id=bbd480dcc51e4433b8894e4280a06f96, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:03.170039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.184344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1175/2334] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:03 2021] PUT /identity/v3/projects/f894ddf21ab34952a4ce25c5c8e57809/users/bbd480dcc51e4433b8894e4280a06f96/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:03.188901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:03.199697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e4150-6aec-4d8f-9c07-2f6f9dcc3f40 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:03.256006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c334-ee30-487b-ad5c-97f1ff332e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:03.256676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c334-ee30-487b-ad5c-97f1ff332e3a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.256963 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c334-ee30-487b-ad5c-97f1ff332e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.257248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c334-ee30-487b-ad5c-97f1ff332e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.257968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c334-ee30-487b-ad5c-97f1ff332e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:03.259611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c334-ee30-487b-ad5c-97f1ff332e3a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.269299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1160/2335] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:03 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:03.273631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:03.284332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ae0f7-cf61-4019-8d49-f37039cf8deb admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:03.288791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:03.289667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.289950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.290225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] PATH_INFO: `/v3/projects/f894ddf21ab34952a4ce25c5c8e57809/users/bbd480dcc51e4433b8894e4280a06f96/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.292127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f894ddf21ab34952a4ce25c5c8e57809, user_id=bbd480dcc51e4433b8894e4280a06f96, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:03.295025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.306120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1176/2336] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:03 2021] PUT /identity/v3/projects/f894ddf21ab34952a4ce25c5c8e57809/users/bbd480dcc51e4433b8894e4280a06f96/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:03.316905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.317457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.317743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.345725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] MFA Rules not processed for user `bbd480dcc51e4433b8894e4280a06f96`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:03.347056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:03.414331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1161/2337] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:03 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:03.424710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:03.477245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafb3bd-a4f2-4fd8-b32b-c2a3add998ff admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:03.480888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:03.481525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:03.481803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:03.482074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:03.536519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:03.537945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:03.545978 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1177/2338] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:03 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:06.635172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:06.645221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8c43d-fe0b-4949-8a46-962d9437ff6f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:06.650255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:06.651231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:06.651679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:06.652019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:06.653890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:06.713834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:06.715329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:06.724180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1162/2339] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:06 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:07.716697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:07.725448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f74b8-4bee-48d5-9fd0-2d4972f4ef06 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:07.731102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412d55-4429-472f-9bb7-2791edf0ba22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:07.731746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412d55-4429-472f-9bb7-2791edf0ba22 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:07.732058 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412d55-4429-472f-9bb7-2791edf0ba22 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:07.732336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412d55-4429-472f-9bb7-2791edf0ba22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:07.741566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412d55-4429-472f-9bb7-2791edf0ba22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:07.743060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412d55-4429-472f-9bb7-2791edf0ba22 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:07.751996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1178/2340] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:07 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:08.724665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:08.726352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:08.794322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a7b0-00fe-4ba7-b722-6d1c2575ce1b service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:08.798585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:08.799698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:08.800705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:08.801006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] PATH_INFO: `/v3/users/61881e51e4d14e4a8e90d9a386fd6a97` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:08.802167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61881e51e4d14e4a8e90d9a386fd6a97)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:08.804128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:08.848671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61881e51e4d14e4a8e90d9a386fd6a97'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:08.849316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61881e51e4d14e4a8e90d9a386fd6a97'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:08.856009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61881e51e4d14e4a8e90d9a386fd6a97'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:08.863471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61881e51e4d14e4a8e90d9a386fd6a97'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:08.864130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61881e51e4d14e4a8e90d9a386fd6a97'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:08.881937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1163/2341] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:08 2021] DELETE /identity/v3/users/61881e51e4d14e4a8e90d9a386fd6a97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:08.886705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:08.887227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:08.887332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:08.904605 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:08.905756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:08.962717 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1179/2342] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:08.972672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:08.974251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:09.031131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ee43-0da7-4c28-b3ca-1c441a389a6a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:09.035617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:09.036193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:09.036479 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:09.036757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:09.045686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:09.047167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:09.056387 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1164/2343] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:09.360726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:09.362171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:09.374801 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f484cb0-6a22-4f5c-8ff6-5ec6632b4423 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:09.384701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:09.385568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:09.385856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:09.386131 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] PATH_INFO: `/v3/projects/a18f8482694c4b33ab7f5d78eb6322e7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:09.387312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18f8482694c4b33ab7f5d78eb6322e7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:09.389243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:09.436943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18f8482694c4b33ab7f5d78eb6322e7', 'request_id': 'req-2637a6b4-4cac-45f1-93eb-6fa482b9781f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.442406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18f8482694c4b33ab7f5d78eb6322e7', 'request_id': 'req-2637a6b4-4cac-45f1-93eb-6fa482b9781f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.451035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18f8482694c4b33ab7f5d78eb6322e7', 'request_id': 'req-2637a6b4-4cac-45f1-93eb-6fa482b9781f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.463682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] The token cache is being invalidate because project a18f8482694c4b33ab7f5d78eb6322e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:09.464035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.464746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.466341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1180/2344] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:09 2021] DELETE /identity/v3/projects/a18f8482694c4b33ab7f5d78eb6322e7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:09.470445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:09.480771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f8833-c8cf-4078-bb5b-3c42c54c044f service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:09.540257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:09.541302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:09.541616 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:09.541896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] PATH_INFO: `/v3/users/17593ca7eede44308a66a3d46d30a5af` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:09.543148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17593ca7eede44308a66a3d46d30a5af)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:09.545122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:09.596303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17593ca7eede44308a66a3d46d30a5af'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.596934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17593ca7eede44308a66a3d46d30a5af'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.604342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17593ca7eede44308a66a3d46d30a5af'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.612525 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17593ca7eede44308a66a3d46d30a5af'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.613347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17593ca7eede44308a66a3d46d30a5af'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:09.630363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1165/2345] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:09 2021] DELETE /identity/v3/users/17593ca7eede44308a66a3d46d30a5af => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:09.908126 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:09.909735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:09.928473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637a6b4-4cac-45f1-93eb-6fa482b9781f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:09.983411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:09.984254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:09.984538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:09.984814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] PATH_INFO: `/v3/projects/7642be9015d746368949137ab28ee02a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:09.985943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7642be9015d746368949137ab28ee02a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:09.988382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.032448 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7642be9015d746368949137ab28ee02a', 'request_id': 'req-3c2a909a-0713-4531-b674-3e43376974a3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.038076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7642be9015d746368949137ab28ee02a', 'request_id': 'req-3c2a909a-0713-4531-b674-3e43376974a3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.044868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7642be9015d746368949137ab28ee02a', 'request_id': 'req-3c2a909a-0713-4531-b674-3e43376974a3'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.058530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] The token cache is being invalidate because project 7642be9015d746368949137ab28ee02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:10.058809 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.059465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.060986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1181/2346] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:09 2021] DELETE /identity/v3/projects/7642be9015d746368949137ab28ee02a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:10.065118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.067549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:10.079322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9cbad-cbdd-428e-af8f-5cfe5de58137 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.133513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.134302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.134583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.134855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] PATH_INFO: `/v3/users/3e518f61080e4e818353e8eb7ce9efde` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.136030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e518f61080e4e818353e8eb7ce9efde)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.137950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.184381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e518f61080e4e818353e8eb7ce9efde'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.185035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e518f61080e4e818353e8eb7ce9efde'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.192251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e518f61080e4e818353e8eb7ce9efde'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.199458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e518f61080e4e818353e8eb7ce9efde'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.200069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1775d8f7-e5f8-4c2a-a8f3-33dafc331344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e518f61080e4e818353e8eb7ce9efde'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.217326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1166/2347] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:10 2021] DELETE /identity/v3/users/3e518f61080e4e818353e8eb7ce9efde => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:10.508551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.509919 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:10.521929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a909a-0713-4531-b674-3e43376974a3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.577296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.578164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.578465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.578729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] PATH_INFO: `/v3/projects/446bd0632bf841a1b595e45e30567999` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.580002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446bd0632bf841a1b595e45e30567999)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.582625 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.630562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446bd0632bf841a1b595e45e30567999', 'request_id': 'req-81524969-0012-4b2e-b2e2-d907dfb242d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.636037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446bd0632bf841a1b595e45e30567999', 'request_id': 'req-81524969-0012-4b2e-b2e2-d907dfb242d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.643652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446bd0632bf841a1b595e45e30567999', 'request_id': 'req-81524969-0012-4b2e-b2e2-d907dfb242d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.655968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] The token cache is being invalidate because project 446bd0632bf841a1b595e45e30567999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:10.656252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.656899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-81524969-0012-4b2e-b2e2-d907dfb242d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:10.658445 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1182/2348] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:10 2021] DELETE /identity/v3/projects/446bd0632bf841a1b595e45e30567999 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:10.667450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.667802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.668143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.684996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:10.686070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:10.742977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1167/2349] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:10.751642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.751942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.752241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.771017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:10.772181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:10.779522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1183/2350] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:10.783724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.792738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad7ad-333f-4f35-a55b-e8815291999e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.797157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.797806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.798124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.798404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.799172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:10.799483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.801295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.812465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1168/2351] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:10.817219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.825768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b91a95-fe61-41ac-bc0d-ba3308e94c8f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.830144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.830784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.831107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.831952 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.832691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.834577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.858824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1184/2352] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:10 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:10.862934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.872521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7accf4-89a8-4a5e-aad4-6705ef7ec2fd admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.926534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.927138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.927425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.927712 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.928399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.930320 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.951932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1169/2353] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:10 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:10.954226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.964652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e49a-de90-4aa4-b7a0-e5839a298f22 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:10.969016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:10.969675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:10.969963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:10.970241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:10.970997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:10.972935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:10.983364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1185/2354] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:10.987311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:10.996700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26205-6ad2-4e9b-ae9d-1672bea58542 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:11.001591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e0ba-236c-4ac2-9b1d-9fc6323e5788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:11.002245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e0ba-236c-4ac2-9b1d-9fc6323e5788 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:11.002526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e0ba-236c-4ac2-9b1d-9fc6323e5788 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:11.002801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e0ba-236c-4ac2-9b1d-9fc6323e5788 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:11.004099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e0ba-236c-4ac2-9b1d-9fc6323e5788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:11.005696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e0ba-236c-4ac2-9b1d-9fc6323e5788 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:11.015642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1170/2355] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:11.020405 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:11.029706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09e7c-00bc-43c4-af3f-7fb04c6e27d8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:11.034101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:11.034995 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:11.035281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:11.035557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] PATH_INFO: `/v3/projects/99f0b70c17cc4c4faed9fd3556deff2c/users/618ba4fd9f7c4774bf6e178bde9335e5/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:11.049275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f0b70c17cc4c4faed9fd3556deff2c, user_id=618ba4fd9f7c4774bf6e178bde9335e5, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:11.052460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:11.065175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1186/2356] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:11 2021] PUT /identity/v3/projects/99f0b70c17cc4c4faed9fd3556deff2c/users/618ba4fd9f7c4774bf6e178bde9335e5/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:11.076542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:11.077024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:11.077120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:11.102830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] MFA Rules not processed for user `618ba4fd9f7c4774bf6e178bde9335e5`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:11.104045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:11.166771 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1171/2357] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:11 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:11.178701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:11.180309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:11.234743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e27b-f7e4-42d1-b04b-1478f05f08e2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:11.238596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1833d-8a08-421d-868d-ff66b97226c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:11.239272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1833d-8a08-421d-868d-ff66b97226c5 service glance] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:11.239556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1833d-8a08-421d-868d-ff66b97226c5 service glance] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:11.239832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1833d-8a08-421d-868d-ff66b97226c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:11.248633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1833d-8a08-421d-868d-ff66b97226c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:11.250072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1833d-8a08-421d-868d-ff66b97226c5 service glance] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:11.258573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1187/2358] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:11 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:12.608450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:12.609944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:12.673350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9c61-0eba-4f70-a5ca-946276f1977b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:12.677778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:12.678673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:12.678993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:12.679277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] PATH_INFO: `/v3/users/c03b4fc33b8a44fd911b540fe5ab2b35` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:12.680429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03b4fc33b8a44fd911b540fe5ab2b35)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:12.682403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:12.730377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03b4fc33b8a44fd911b540fe5ab2b35'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:12.731075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03b4fc33b8a44fd911b540fe5ab2b35'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:12.738478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03b4fc33b8a44fd911b540fe5ab2b35'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:12.747578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03b4fc33b8a44fd911b540fe5ab2b35'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:12.748091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03b4fc33b8a44fd911b540fe5ab2b35'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:12.765553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1172/2359] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:12 2021] DELETE /identity/v3/users/c03b4fc33b8a44fd911b540fe5ab2b35 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:12.770096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:12.770601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:12.770710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:12.788267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:12.789593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:12.851245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1188/2360] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:12.860749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:12.862082 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:12.921737 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88915c9-1f08-4d33-a18b-3e29765b7640 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:12.925235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:12.925880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:12.926162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:12.926437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:12.934819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:12.936298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:12.945934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1173/2361] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:13.232393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:13.233770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:13.251436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c08c4-1b0a-4b27-b05f-5e85689b195c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:13.256901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:13.257760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.258039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.258349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] PATH_INFO: `/v3/projects/9345a990fc7d469ebe56b001681cb930` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.265918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9345a990fc7d469ebe56b001681cb930)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:13.267877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:13.319413 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9345a990fc7d469ebe56b001681cb930', 'request_id': 'req-1fb5e2a8-2865-457e-9347-1e602f6db534'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.324575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9345a990fc7d469ebe56b001681cb930', 'request_id': 'req-1fb5e2a8-2865-457e-9347-1e602f6db534'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.332821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9345a990fc7d469ebe56b001681cb930', 'request_id': 'req-1fb5e2a8-2865-457e-9347-1e602f6db534'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.343550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] The token cache is being invalidate because project 9345a990fc7d469ebe56b001681cb930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:13.343841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.344477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.346019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1189/2362] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:13 2021] DELETE /identity/v3/projects/9345a990fc7d469ebe56b001681cb930 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:13.350871 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:13.359738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373710a2-0c8d-4e66-99bc-ffe0bccddd99 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:13.416211 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:13.417062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.417342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.417612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] PATH_INFO: `/v3/users/bbd480dcc51e4433b8894e4280a06f96` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.418749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd480dcc51e4433b8894e4280a06f96)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:13.420708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:13.468581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd480dcc51e4433b8894e4280a06f96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.469230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd480dcc51e4433b8894e4280a06f96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.476698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd480dcc51e4433b8894e4280a06f96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.483886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd480dcc51e4433b8894e4280a06f96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.484545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dc60164b-4482-4e84-b1c7-c031b6af2463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd480dcc51e4433b8894e4280a06f96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.501569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1174/2363] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:13 2021] DELETE /identity/v3/users/bbd480dcc51e4433b8894e4280a06f96 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:13.784223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:13.785789 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:13.799271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5e2a8-2865-457e-9347-1e602f6db534 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:13.867251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:13.868105 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.868408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.868731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] PATH_INFO: `/v3/projects/f894ddf21ab34952a4ce25c5c8e57809` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.869954 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f894ddf21ab34952a4ce25c5c8e57809)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:13.872519 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:13.919711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f894ddf21ab34952a4ce25c5c8e57809', 'request_id': 'req-40ddca48-1136-4a24-98af-a12cdb040b2a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.925491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f894ddf21ab34952a4ce25c5c8e57809', 'request_id': 'req-40ddca48-1136-4a24-98af-a12cdb040b2a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.932988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f894ddf21ab34952a4ce25c5c8e57809', 'request_id': 'req-40ddca48-1136-4a24-98af-a12cdb040b2a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.944914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] The token cache is being invalidate because project f894ddf21ab34952a4ce25c5c8e57809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:13.944914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.945770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40ddca48-1136-4a24-98af-a12cdb040b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:13.947317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1190/2364] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:13 2021] DELETE /identity/v3/projects/f894ddf21ab34952a4ce25c5c8e57809 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:13.954090 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:13.954569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:13.954672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:13.972603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:13.973912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:14.029966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1175/2365] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:14.040084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.040368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.040643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.059109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:14.060286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:14.067695 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1191/2366] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:14.072005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.081585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89b1c-f5c0-4c0c-b390-1430b3d039a2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.086109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.086788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.087193 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.087492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.088363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:14.088674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.090719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.103263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1176/2367] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 08:45:14.107852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.116576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f0f6a-19c4-440e-8a62-a63d4b7334aa None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.121162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.121747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.122026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.122572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.123308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.125382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.152001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1192/2368] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:14 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:14.157030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.167537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3db9b-7f9b-4a6a-aeaa-02ffc84334ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.224549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.224845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.225127 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.225545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.226068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.228049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.251868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1177/2369] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:14 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:14.254387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.264115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05790a50-8578-4874-88ef-73887b13b38d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.269392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.270047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.270334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.270611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.271394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.273061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.284836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1193/2370] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:14.289185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.298399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a71d1-bc19-44b8-bd9c-7465bfb86b28 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.303280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a418e35-a17b-42fd-b7df-5d3df9d54d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.303927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a418e35-a17b-42fd-b7df-5d3df9d54d8a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.304212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a418e35-a17b-42fd-b7df-5d3df9d54d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.304492 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a418e35-a17b-42fd-b7df-5d3df9d54d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.305215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a418e35-a17b-42fd-b7df-5d3df9d54d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.306815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a418e35-a17b-42fd-b7df-5d3df9d54d8a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.318056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1178/2371] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:14.322185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.331748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09243f7-25ca-443e-b3aa-62978b5f7932 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.336104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.336983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.337265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.337583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] PATH_INFO: `/v3/projects/25efde7df7f64b5d980b409f6ccfa28c/users/35bceb3466aa4dcea7c5af7f84573e50/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.352574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25efde7df7f64b5d980b409f6ccfa28c, user_id=35bceb3466aa4dcea7c5af7f84573e50, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.355284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.368322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1194/2372] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:14 2021] PUT /identity/v3/projects/25efde7df7f64b5d980b409f6ccfa28c/users/35bceb3466aa4dcea7c5af7f84573e50/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:14.380394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.380585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.380886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.407902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] MFA Rules not processed for user `35bceb3466aa4dcea7c5af7f84573e50`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:14.409135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:14.475161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1179/2373] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:14 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:14.485067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:14.486876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:14.547171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85fe18-e694-4f1f-bc6b-7cc9c35d2816 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:14.551697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e286-6699-4b90-85cf-71b31a8ca188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:14.552350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e286-6699-4b90-85cf-71b31a8ca188 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:14.552629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e286-6699-4b90-85cf-71b31a8ca188 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:14.552903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e286-6699-4b90-85cf-71b31a8ca188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:14.561408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e286-6699-4b90-85cf-71b31a8ca188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:14.562864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e286-6699-4b90-85cf-71b31a8ca188 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:14.571128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1195/2374] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:14 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:17.616906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:17.676639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f2f35-02e8-4cf5-8b73-2366eb4ea045 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:17.680915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:17.681773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:17.682052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:17.682325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] PATH_INFO: `/v3/users/35bceb3466aa4dcea7c5af7f84573e50` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:17.683487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bceb3466aa4dcea7c5af7f84573e50)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:17.685442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:17.733029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bceb3466aa4dcea7c5af7f84573e50'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:17.733677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bceb3466aa4dcea7c5af7f84573e50'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:17.740713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bceb3466aa4dcea7c5af7f84573e50'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:17.748059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bceb3466aa4dcea7c5af7f84573e50'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:17.748665 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bceb3466aa4dcea7c5af7f84573e50'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:17.766324 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1180/2375] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:17 2021] DELETE /identity/v3/users/35bceb3466aa4dcea7c5af7f84573e50 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:17.772327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:17.772813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:17.772917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:17.790623 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:17.792222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:17.849313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1196/2376] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:17.859650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:17.861048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:17.922625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ced1a-5819-4745-94b3-4b4868127799 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:17.926717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce338f-2e11-4d6a-829c-3b4c32c77b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:17.927398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce338f-2e11-4d6a-829c-3b4c32c77b3d service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:17.927684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce338f-2e11-4d6a-829c-3b4c32c77b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:17.927962 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce338f-2e11-4d6a-829c-3b4c32c77b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:17.936505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce338f-2e11-4d6a-829c-3b4c32c77b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:17.938145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce338f-2e11-4d6a-829c-3b4c32c77b3d service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:17.947627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1181/2377] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:18.227799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.229168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:18.242148 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2455a-45c8-439a-adaa-e6ab5c409a0a None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.253617 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.255433 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.255727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.255936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] PATH_INFO: `/v3/projects/25efde7df7f64b5d980b409f6ccfa28c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.257294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25efde7df7f64b5d980b409f6ccfa28c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.259317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.309157 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25efde7df7f64b5d980b409f6ccfa28c', 'request_id': 'req-846140a0-0410-4214-9f73-46c82cc0e25c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:18.314358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25efde7df7f64b5d980b409f6ccfa28c', 'request_id': 'req-846140a0-0410-4214-9f73-46c82cc0e25c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:18.321668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25efde7df7f64b5d980b409f6ccfa28c', 'request_id': 'req-846140a0-0410-4214-9f73-46c82cc0e25c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:18.333150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] The token cache is being invalidate because project 25efde7df7f64b5d980b409f6ccfa28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:18.333438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:18.334068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-846140a0-0410-4214-9f73-46c82cc0e25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:18.335635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1197/2378] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:18 2021] DELETE /identity/v3/projects/25efde7df7f64b5d980b409f6ccfa28c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:18.341848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.342190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.342730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.360557 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:18.361659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:18.420236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1182/2379] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:18.428986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.429271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.429550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.447807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:18.448984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:18.456362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1198/2380] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:18.460649 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.469491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085dd9c-1bbe-435e-8954-68d148b9f1ef None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.474623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.475316 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.475591 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.475864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.476584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:18.476883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.478465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.490886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1183/2381] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:18.496331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.507367 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95082406-5d43-4c60-97b3-79d09f37356e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.511747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.512406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.512687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.512960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.513656 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.515596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.542101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1199/2382] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:18.546567 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.561853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342923c9-9720-4e9e-8028-27b94d999b3f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.617450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.618176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.618287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.618549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.619288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.621177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.640801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1184/2383] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:18.645551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.655758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574624-8abf-418b-8c9c-bcada1a602c6 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.660502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.661161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.661447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.661723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.662439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.664101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.674253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1200/2384] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:18.678765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.687861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8ee4-540b-4c49-9c51-920c2c569a85 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.693589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89e027-ab80-4ebe-8565-f1d4ce3bb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.694264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89e027-ab80-4ebe-8565-f1d4ce3bb529 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.694549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89e027-ab80-4ebe-8565-f1d4ce3bb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.694855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89e027-ab80-4ebe-8565-f1d4ce3bb529 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.695619 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89e027-ab80-4ebe-8565-f1d4ce3bb529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.697243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89e027-ab80-4ebe-8565-f1d4ce3bb529 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.708924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1185/2385] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:18.712972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.722310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bc966-d9ab-4cc7-9cb2-4db1836d41b9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.726868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.727768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.728050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.728328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] PATH_INFO: `/v3/projects/48efd5f703c546ce8692e251abe34431/users/3ad2bcd0a986423e95938093c7c25e7c/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.742731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48efd5f703c546ce8692e251abe34431, user_id=3ad2bcd0a986423e95938093c7c25e7c, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.745434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.758841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1201/2386] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:18 2021] PUT /identity/v3/projects/48efd5f703c546ce8692e251abe34431/users/3ad2bcd0a986423e95938093c7c25e7c/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:18.769820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.770117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.770394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.797821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] MFA Rules not processed for user `3ad2bcd0a986423e95938093c7c25e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:18.799129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:18.863044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1186/2387] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:18.868251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.933037 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d852-169e-4b5f-9a28-02a5c5b91201 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:18.937485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:18.938140 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:18.938427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:18.938706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:18.939426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:18.941368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:18.965468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1202/2388] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:18.969494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:18.979952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc997f-470f-4cb6-a653-4cc80df81947 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.035959 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.036627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.036912 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.037183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.037866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.039813 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.065194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1187/2389] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:18 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:19.066389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.076802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f736b-7590-4d84-b643-d9851bca1509 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.081252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.082168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.083088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.083376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.084135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.085762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.098095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1203/2390] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:19.104140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.114465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89f98b-78b0-4fa4-814a-38ae91ae80ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.119232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb925-b94b-4f12-8af8-91eb2af4b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.119792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb925-b94b-4f12-8af8-91eb2af4b53a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.120118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb925-b94b-4f12-8af8-91eb2af4b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.120401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb925-b94b-4f12-8af8-91eb2af4b53a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.121135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bb925-b94b-4f12-8af8-91eb2af4b53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.123036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bb925-b94b-4f12-8af8-91eb2af4b53a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.133371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1188/2391] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:19.137659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.147202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8943c3-0c34-4517-918d-6d19b59355cf admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.152158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.153239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.153606 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.153966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] PATH_INFO: `/v3/projects/22592a07504941358604bab1edc596e8/users/d6b19ffd802948798ef5e4600d7346d1/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.169201 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22592a07504941358604bab1edc596e8, user_id=d6b19ffd802948798ef5e4600d7346d1, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.171893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.184654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1204/2392] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:19 2021] PUT /identity/v3/projects/22592a07504941358604bab1edc596e8/users/d6b19ffd802948798ef5e4600d7346d1/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:19.196148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.196497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.196969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.223248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] MFA Rules not processed for user `d6b19ffd802948798ef5e4600d7346d1`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:19.224425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:19.290057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1189/2393] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:19 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:19.294559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.357907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e456d8-31c1-4c94-98ea-2fbe54c789f7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.362411 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.363768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.364579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.364912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.365555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.367492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.392787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1205/2394] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:19 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:19.396760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.406552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d5a1-a829-41bd-b0ee-8261f024abc2 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.462126 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.462811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.463136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.463416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.464105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.466039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.485420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1190/2395] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:19 2021] POST /identity/v3/users => generated 298 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:19.490558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.500524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f151f-8572-4b80-a865-ca6dca9eea36 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.505673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.506556 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.506847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.507166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.507916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.509531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.520383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1206/2396] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:45:19.525662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.536904 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2010d-6f15-4023-9857-9c0d951fd0d6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.542593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.543551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.543828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.544097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] PATH_INFO: `/v3/projects/d682503833a6446190dc2df0f22bfd70/users/e72854e3d76946af9d71bf8204b1bf44/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.559363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d682503833a6446190dc2df0f22bfd70, user_id=e72854e3d76946af9d71bf8204b1bf44, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.561995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.577457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1191/2397] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:19 2021] PUT /identity/v3/projects/d682503833a6446190dc2df0f22bfd70/users/e72854e3d76946af9d71bf8204b1bf44/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:19.581404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.591905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcf027-45bb-4b7e-a150-c333c756a982 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.651222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae01a-4c8e-490c-9a51-24f6fefd3486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.651804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae01a-4c8e-490c-9a51-24f6fefd3486 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.652088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae01a-4c8e-490c-9a51-24f6fefd3486 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.652360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae01a-4c8e-490c-9a51-24f6fefd3486 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.653094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae01a-4c8e-490c-9a51-24f6fefd3486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.654687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae01a-4c8e-490c-9a51-24f6fefd3486 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.664089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1207/2398] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:19.668278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.678944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c1187-ca97-4df2-b46a-439a753cf5d5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.683455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.684342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.684624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.684903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] PATH_INFO: `/v3/projects/d682503833a6446190dc2df0f22bfd70/users/e72854e3d76946af9d71bf8204b1bf44/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.686738 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d682503833a6446190dc2df0f22bfd70, user_id=e72854e3d76946af9d71bf8204b1bf44, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.689632 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.700571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1192/2399] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:19 2021] PUT /identity/v3/projects/d682503833a6446190dc2df0f22bfd70/users/e72854e3d76946af9d71bf8204b1bf44/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:19.712055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.712406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.712683 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.737883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] MFA Rules not processed for user `e72854e3d76946af9d71bf8204b1bf44`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:19.739162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:19.808057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1208/2400] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:19 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:19.818765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:19.820462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:19.877470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770c91-466b-441e-a94f-d1fe4e0c11ed admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:19.882143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:19.882831 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:19.883148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:19.883431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:19.943207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:19.944569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:19.959611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1193/2401] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:19 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:21.459102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:21.468162 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5ed0f-120b-4ada-bf6c-6753e4071e35 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:21.471467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:21.472099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:21.472374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:21.473293 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:21.527235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:21.528661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:21.537699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1209/2402] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:21 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:22.083075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:22.091416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6bf8-6790-4d8b-adef-d41c6a841f73 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:22.094939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b5eb5-b613-48cf-add5-282ef107bf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:22.095655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5eb5-b613-48cf-add5-282ef107bf1a service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:22.095898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5eb5-b613-48cf-add5-282ef107bf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:22.096172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5eb5-b613-48cf-add5-282ef107bf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:22.106285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b5eb5-b613-48cf-add5-282ef107bf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:22.107859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b5eb5-b613-48cf-add5-282ef107bf1a service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:22.117563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1194/2403] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:22 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:26.074012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:26.136903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac99b-eaea-4b66-afb6-e3125f37db99 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:26.141235 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:26.142098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:26.142379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:26.142655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] PATH_INFO: `/v3/users/3ad2bcd0a986423e95938093c7c25e7c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:26.143824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad2bcd0a986423e95938093c7c25e7c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:26.146375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:26.191566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad2bcd0a986423e95938093c7c25e7c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.198040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad2bcd0a986423e95938093c7c25e7c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.198703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad2bcd0a986423e95938093c7c25e7c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.210467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad2bcd0a986423e95938093c7c25e7c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.217566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad2bcd0a986423e95938093c7c25e7c'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.224506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1210/2404] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:26 2021] DELETE /identity/v3/users/3ad2bcd0a986423e95938093c7c25e7c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:26.229042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:26.229574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:26.229672 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:26.251970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:26.254602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:26.318226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1195/2405] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:26.328927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:26.330318 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:26.393585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf28e-7656-4f6f-93cf-dc5e3f5ee300 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:26.398522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:26.399217 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:26.399500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:26.399777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:26.409804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:26.412076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:26.422493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1211/2406] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:26.749076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:26.750581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:26.765648 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939a95b-65d9-41f7-8df7-f8f4c3a5c285 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:26.770939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:26.771832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:26.772118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:26.772400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] PATH_INFO: `/v3/projects/48efd5f703c546ce8692e251abe34431` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:26.773660 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48efd5f703c546ce8692e251abe34431)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:26.775676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:26.833328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48efd5f703c546ce8692e251abe34431', 'request_id': 'req-998e12a0-9f87-40a3-832c-d67cf1870309'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.839061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48efd5f703c546ce8692e251abe34431', 'request_id': 'req-998e12a0-9f87-40a3-832c-d67cf1870309'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.847994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48efd5f703c546ce8692e251abe34431', 'request_id': 'req-998e12a0-9f87-40a3-832c-d67cf1870309'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.860521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] The token cache is being invalidate because project 48efd5f703c546ce8692e251abe34431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:26.860729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.861351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:26.863425 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1196/2407] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:26 2021] DELETE /identity/v3/projects/48efd5f703c546ce8692e251abe34431 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:26.867692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:26.877199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b91fe-b747-4d5b-b81f-1051bebf7692 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:26.938449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:26.939358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:26.939643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:26.939914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] PATH_INFO: `/v3/users/d6b19ffd802948798ef5e4600d7346d1` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:26.941113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b19ffd802948798ef5e4600d7346d1)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:26.943098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:26.994562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b19ffd802948798ef5e4600d7346d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.001970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b19ffd802948798ef5e4600d7346d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.002719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b19ffd802948798ef5e4600d7346d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.015479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b19ffd802948798ef5e4600d7346d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.023089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b19ffd802948798ef5e4600d7346d1'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.029429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1212/2408] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:26 2021] DELETE /identity/v3/users/d6b19ffd802948798ef5e4600d7346d1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:27.338971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:27.340380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:27.353148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e12a0-9f87-40a3-832c-d67cf1870309 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:27.412983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:27.413913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.414201 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.414480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] PATH_INFO: `/v3/projects/22592a07504941358604bab1edc596e8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.415762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22592a07504941358604bab1edc596e8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:27.417683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:27.466807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22592a07504941358604bab1edc596e8', 'request_id': 'req-1984ae83-63d2-47f2-8121-37df35f6e440'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.472770 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22592a07504941358604bab1edc596e8', 'request_id': 'req-1984ae83-63d2-47f2-8121-37df35f6e440'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.481421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22592a07504941358604bab1edc596e8', 'request_id': 'req-1984ae83-63d2-47f2-8121-37df35f6e440'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.493536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] The token cache is being invalidate because project 22592a07504941358604bab1edc596e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:27.493820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.494475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.496079 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1197/2409] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:27 2021] DELETE /identity/v3/projects/22592a07504941358604bab1edc596e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:27.500358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:27.501980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:27.514797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731586b4-3579-4f99-b270-9cc513358b4c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:27.587271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:27.588173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:27.588461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:27.588740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] PATH_INFO: `/v3/users/e72854e3d76946af9d71bf8204b1bf44` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:27.589971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72854e3d76946af9d71bf8204b1bf44)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:27.592015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:27.640478 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72854e3d76946af9d71bf8204b1bf44'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.647581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72854e3d76946af9d71bf8204b1bf44'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.648278 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72854e3d76946af9d71bf8204b1bf44'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.659951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72854e3d76946af9d71bf8204b1bf44'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.668076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a467a60-6ea3-4538-94b3-8ff95de9773b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72854e3d76946af9d71bf8204b1bf44'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:27.674473 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1213/2410] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:27 2021] DELETE /identity/v3/users/e72854e3d76946af9d71bf8204b1bf44 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:27.965403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:27.966956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:27.979546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984ae83-63d2-47f2-8121-37df35f6e440 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.042176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.043180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.043468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.043744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] PATH_INFO: `/v3/projects/d682503833a6446190dc2df0f22bfd70` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.044925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d682503833a6446190dc2df0f22bfd70)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.046867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.093786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd682503833a6446190dc2df0f22bfd70', 'request_id': 'req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:28.099787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd682503833a6446190dc2df0f22bfd70', 'request_id': 'req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:28.108062 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd682503833a6446190dc2df0f22bfd70', 'request_id': 'req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:28.120465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] The token cache is being invalidate because project d682503833a6446190dc2df0f22bfd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:28.120752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:28.121411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-cd3e85bb-2766-4c42-823f-3a9d0f0f5330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:28.123248 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1198/2411] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:27 2021] DELETE /identity/v3/projects/d682503833a6446190dc2df0f22bfd70 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:28.129072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.129359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.129633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.147690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:28.148869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:28.208788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1214/2412] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:28.216998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.217283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.217658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.239659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:28.240856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:28.259791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1199/2413] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:28.259983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.266503 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a095ee4-9f00-4f62-b347-c3353dd11e2f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.271597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.272265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.272547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.272826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.273554 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:28.273867 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.275513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.287854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1215/2414] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:28.294168 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.304560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5753-6c7a-40c3-8231-fe65b49879f6 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.309271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.309932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.310210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.310484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.311213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.313169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.339024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1200/2415] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:28 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:28.347085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.357260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157971fa-b60a-4179-9f1c-23f0f8a6485a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.414106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.414784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.415106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.415387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.416095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.418019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.439959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1216/2416] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:28 2021] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:28.446183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.456084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6c271-7b75-485a-b5aa-4ed8b5d8c58f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.460707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.461313 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.461621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.461895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.462664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.464301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.475195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1201/2417] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:28.479593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.490097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2432ae-1213-4efe-a09c-406bad5bdfb9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.494775 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d903-ba23-4057-b35e-4d31f0531975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.495518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d903-ba23-4057-b35e-4d31f0531975 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.495934 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d903-ba23-4057-b35e-4d31f0531975 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.496060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d903-ba23-4057-b35e-4d31f0531975 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.497051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d903-ba23-4057-b35e-4d31f0531975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.498682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d903-ba23-4057-b35e-4d31f0531975 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.509701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1217/2418] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:28.513933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.523740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112de2-486c-4866-9e52-acc7099a67e3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.528124 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.529007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.529286 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.529562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] PATH_INFO: `/v3/projects/1b1c50957d614bf3b196a9502dbb0872/users/5de6ce3baedc402b982fa28cf4412889/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.544761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1c50957d614bf3b196a9502dbb0872, user_id=5de6ce3baedc402b982fa28cf4412889, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.547362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.561683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1202/2419] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:28 2021] PUT /identity/v3/projects/1b1c50957d614bf3b196a9502dbb0872/users/5de6ce3baedc402b982fa28cf4412889/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:28.567772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891c0e-dce3-4c16-a2ed-fd19eebf17c5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.568200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891c0e-dce3-4c16-a2ed-fd19eebf17c5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.568596 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891c0e-dce3-4c16-a2ed-fd19eebf17c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.587592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0c891c0e-dce3-4c16-a2ed-fd19eebf17c5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:28.588609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0c891c0e-dce3-4c16-a2ed-fd19eebf17c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:28.652813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1218/2420] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:28.667137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:28.668833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:28.731748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fb554-08e6-42df-9699-87e0a512b6ba admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:28.736022 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:28.736676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:28.736961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:28.737239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:28.746410 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:28.748179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:28.758224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1203/2421] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:29.433914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:29.434436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:29.435097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:29.480482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] MFA Rules not processed for user `5de6ce3baedc402b982fa28cf4412889`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:29.482483 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:29.565600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1219/2422] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:29 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:29.577617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:29.579783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:29.649513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0449540-dd9a-4006-a5ff-c933c2f0ed2e service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:29.653442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5214a-a1ee-40f2-b531-5ba8e7311783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:29.654379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5214a-a1ee-40f2-b531-5ba8e7311783 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:29.654673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5214a-a1ee-40f2-b531-5ba8e7311783 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:29.654987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5214a-a1ee-40f2-b531-5ba8e7311783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:29.666003 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5214a-a1ee-40f2-b531-5ba8e7311783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:29.667520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5214a-a1ee-40f2-b531-5ba8e7311783 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:29.679659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1204/2423] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:29 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:31.080469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:31.083129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.098634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebfcdd-b4cd-4eb5-94a8-627fc130fd62 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:31.103074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:31.103969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.104259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.104538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] PATH_INFO: `/v3/users/618ba4fd9f7c4774bf6e178bde9335e5` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.105758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=618ba4fd9f7c4774bf6e178bde9335e5)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:31.107758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:31.137811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8436-6133-4051-9ec6-1d6eefb305b4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.138371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8436-6133-4051-9ec6-1d6eefb305b4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.138371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8436-6133-4051-9ec6-1d6eefb305b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.158113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9e6e8436-6133-4051-9ec6-1d6eefb305b4 None None] MFA Rules not processed for user `5de6ce3baedc402b982fa28cf4412889`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:31.159328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9e6e8436-6133-4051-9ec6-1d6eefb305b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.168775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1205/2424] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:31 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:31.173401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618ba4fd9f7c4774bf6e178bde9335e5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.181582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618ba4fd9f7c4774bf6e178bde9335e5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.182294 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618ba4fd9f7c4774bf6e178bde9335e5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.195281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618ba4fd9f7c4774bf6e178bde9335e5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.202821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618ba4fd9f7c4774bf6e178bde9335e5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.211386 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1220/2425] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:31 2021] DELETE /identity/v3/users/618ba4fd9f7c4774bf6e178bde9335e5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:31.216138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.216426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.216703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.239028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:31.241192 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.321145 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1206/2426] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:31.331085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:31.333175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.392693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad45239-0c55-44aa-98ee-00d70b4084c1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:31.397026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5867cdd-e72c-429b-8867-cafcf431504e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:31.397741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5867cdd-e72c-429b-8867-cafcf431504e service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.398026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5867cdd-e72c-429b-8867-cafcf431504e service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.398301 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5867cdd-e72c-429b-8867-cafcf431504e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.408582 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5867cdd-e72c-429b-8867-cafcf431504e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:31.411111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5867cdd-e72c-429b-8867-cafcf431504e service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:31.420882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1221/2427] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:31.725955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:31.729025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.743800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38a986-acf5-49af-be13-5e7675898b67 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:31.750744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:31.751901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.752187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.752465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] PATH_INFO: `/v3/projects/99f0b70c17cc4c4faed9fd3556deff2c` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.754180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f0b70c17cc4c4faed9fd3556deff2c)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:31.756150 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:31.811447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f0b70c17cc4c4faed9fd3556deff2c', 'request_id': 'req-31fdf023-21b9-4b15-8498-6236bdbfdd2d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.818087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f0b70c17cc4c4faed9fd3556deff2c', 'request_id': 'req-31fdf023-21b9-4b15-8498-6236bdbfdd2d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.826575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f0b70c17cc4c4faed9fd3556deff2c', 'request_id': 'req-31fdf023-21b9-4b15-8498-6236bdbfdd2d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.851138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] The token cache is being invalidate because project 99f0b70c17cc4c4faed9fd3556deff2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:31.851138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.851138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-31fdf023-21b9-4b15-8498-6236bdbfdd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:31.851138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1207/2428] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:31 2021] DELETE /identity/v3/projects/99f0b70c17cc4c4faed9fd3556deff2c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:31.854151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.854488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.854771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.873841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:31.875197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.942137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1222/2429] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:31.951158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:31.951629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:31.951742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:31.970097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:31.971634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:31.980256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1208/2430] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:31.985323 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:31.999531 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3cd45-f9f0-461c-a90c-d8d5d1a8bcb1 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.008171 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.009192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.009502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.009985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.010670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:32.011038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.012772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.027989 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1223/2431] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:32.032578 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.043580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da48c23-cd66-490c-99db-c4d2351d90df None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.048307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.048973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.049255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.049552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.050367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.052853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.090160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1209/2432] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:32 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:32.091702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.104853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b07a9f-4c68-4d9d-8b6f-95dd076ef09d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.170285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.171082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.171401 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.171861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.172431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.174419 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.202984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1224/2433] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:32 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:32.207344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.221642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b811-f35b-4bfc-ad61-6ab39d7f7c8c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.226939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.227654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.227935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.228407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.229149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.230797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.245238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1210/2434] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:32 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:32.250425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.261458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bc6d0-c2aa-4964-a48d-8a38d07e3883 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.265998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c558118-996a-4113-bba8-1a5f20441cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.266682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c558118-996a-4113-bba8-1a5f20441cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.266999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c558118-996a-4113-bba8-1a5f20441cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.267352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c558118-996a-4113-bba8-1a5f20441cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.268026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c558118-996a-4113-bba8-1a5f20441cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.269663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c558118-996a-4113-bba8-1a5f20441cc9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.280846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1225/2435] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:32.287139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.297057 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d608115-9a98-4553-add8-c8187fa6d166 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.303622 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.304550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.304836 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.305113 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] PATH_INFO: `/v3/projects/20a33f34dd3d4e9cbebe7050177359aa/users/a415130e8f5f4618830de32c67e75a02/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.324159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a33f34dd3d4e9cbebe7050177359aa, user_id=a415130e8f5f4618830de32c67e75a02, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.326880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.341129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1211/2436] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:32 2021] PUT /identity/v3/projects/20a33f34dd3d4e9cbebe7050177359aa/users/a415130e8f5f4618830de32c67e75a02/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:32.353669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.353958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.354237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.390066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] MFA Rules not processed for user `a415130e8f5f4618830de32c67e75a02`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:32.391314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:32.461643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1226/2437] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:32.473070 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:32.474901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:32.548856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3ea9-cc7f-4440-a107-1af8a6391958 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:32.554625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4d71-001b-4d37-909a-ce39ce3bb7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:32.555331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4d71-001b-4d37-909a-ce39ce3bb7fe service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:32.555626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4d71-001b-4d37-909a-ce39ce3bb7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:32.555903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4d71-001b-4d37-909a-ce39ce3bb7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:32.565502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa4d71-001b-4d37-909a-ce39ce3bb7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:32.567326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa4d71-001b-4d37-909a-ce39ce3bb7fe service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:32.575493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1212/2438] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:32 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:35.182779 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:35.261234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b7649-d646-4dc0-b796-d8e1135a8cb4 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:35.266402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:35.267515 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:35.267663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:35.267928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] PATH_INFO: `/v3/users/a415130e8f5f4618830de32c67e75a02` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:35.269525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a415130e8f5f4618830de32c67e75a02)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:35.272584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:35.326273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a415130e8f5f4618830de32c67e75a02'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:35.334567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a415130e8f5f4618830de32c67e75a02'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:35.335489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a415130e8f5f4618830de32c67e75a02'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:35.352909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a415130e8f5f4618830de32c67e75a02'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:35.364783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a415130e8f5f4618830de32c67e75a02'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:35.373734 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1227/2439] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:35 2021] DELETE /identity/v3/users/a415130e8f5f4618830de32c67e75a02 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:35.378612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:35.379739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:35.379739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:35.398587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:35.399989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:35.478576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1213/2440] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:35.497387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:35.497387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:35.560788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530761-6bb7-4e1a-9184-fd6972c317ce admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:35.564664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453f73-bec7-44c9-a460-6668fc8b2116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:35.565410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453f73-bec7-44c9-a460-6668fc8b2116 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:35.565762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453f73-bec7-44c9-a460-6668fc8b2116 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:35.566109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453f73-bec7-44c9-a460-6668fc8b2116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:35.576253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453f73-bec7-44c9-a460-6668fc8b2116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:35.578416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453f73-bec7-44c9-a460-6668fc8b2116 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:35.589080 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1228/2441] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:36.106533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.108954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:36.129450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c218943-51f5-4c07-94a8-c37edb2bd720 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.137028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.137905 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.138189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.138494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] PATH_INFO: `/v3/projects/20a33f34dd3d4e9cbebe7050177359aa` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.139725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a33f34dd3d4e9cbebe7050177359aa)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.141774 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.196140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a33f34dd3d4e9cbebe7050177359aa', 'request_id': 'req-d017b839-1ff1-429e-a6cb-7899eb579816'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:36.201433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a33f34dd3d4e9cbebe7050177359aa', 'request_id': 'req-d017b839-1ff1-429e-a6cb-7899eb579816'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:36.210438 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a33f34dd3d4e9cbebe7050177359aa', 'request_id': 'req-d017b839-1ff1-429e-a6cb-7899eb579816'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:36.222640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] The token cache is being invalidate because project 20a33f34dd3d4e9cbebe7050177359aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:36.223608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:36.224553 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d017b839-1ff1-429e-a6cb-7899eb579816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:36.226422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1214/2442] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:36 2021] DELETE /identity/v3/projects/20a33f34dd3d4e9cbebe7050177359aa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:45:36.232183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.232705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.232804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.261170 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:36.262461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:36.327202 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1229/2443] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 08:45:36.336374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.336732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.337018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.357118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:36.357118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:36.365797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1215/2444] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:36.370077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.380223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb575ae-fbef-43f4-8f8d-928c522ae8ed None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.384701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.385363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.385647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.385928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.386647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:45:36.386979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.388579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.400966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1230/2445] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:45:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:45:36.406528 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.416466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e5be1-57d6-43fd-bbbd-f03e57140bc6 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.421257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.421935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.422219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.422497 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.423246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.425175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.453039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1216/2446] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:45:36 2021] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:45:36.457426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.467214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c306-3036-46f5-b7ee-d8a1d4a22be3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.529325 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.530007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.530295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.530577 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.531306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.533251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.555703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1231/2447] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:45:36 2021] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:45:36.559910 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.571083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3267e49-0e46-470d-8ef8-8445118bfe3d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.577239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.578434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.578996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.579520 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.580725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.583802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.598821 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1217/2448] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:36 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:36.604532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.619347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ce25-4362-442e-8cc6-9438bc1fb6ac admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.624269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5415ba6-edb6-4052-87f8-ca1c820f76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.624943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5415ba6-edb6-4052-87f8-ca1c820f76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.625234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5415ba6-edb6-4052-87f8-ca1c820f76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.625654 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5415ba6-edb6-4052-87f8-ca1c820f76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.626456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5415ba6-edb6-4052-87f8-ca1c820f76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.628164 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5415ba6-edb6-4052-87f8-ca1c820f76e5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.647265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1232/2449] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:45:36 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:45:36.651299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.661400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081ef76-a5fd-4767-afd7-40b80df38612 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.666841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.667777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.668058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.668331 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] PATH_INFO: `/v3/projects/b963c5bbc6134869ad5ec4cb0e530c69/users/e891180d99124077855af9fbc631cd94/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.684688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b963c5bbc6134869ad5ec4cb0e530c69, user_id=e891180d99124077855af9fbc631cd94, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.687405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.702789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1218/2450] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:45:36 2021] PUT /identity/v3/projects/b963c5bbc6134869ad5ec4cb0e530c69/users/e891180d99124077855af9fbc631cd94/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:36.714459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.714745 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.715053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.742674 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] MFA Rules not processed for user `e891180d99124077855af9fbc631cd94`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:36.743893 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:36.825821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1233/2451] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:36 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:36.837428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.839901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:36.901188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:36.902968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:36.914254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a0a6c-6362-4fb9-806c-8d2e5c52942c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.918083 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.918879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.919881 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.919881 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.930170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:36.931674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:36.941526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1219/2452] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:36 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:36.976454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6ce7b-91bb-41cc-ba01-087f88d577b2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:36.980085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:36.980729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:36.981147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:36.981423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:36.983449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:37.072266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:37.072266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e0cd-5062-47c5-8e5b-232678fc7f54 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:37.084840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1234/2453] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:37.425510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:37.427063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:37.439555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9618e4-7d99-4415-8f34-6a150bb8d275 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:37.444283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:37.444954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:37.445241 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:37.445524 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:37.456069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:37.473979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:37.475516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:37.487228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1220/2454] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:41.130951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:41.131862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:41.131862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:41.151298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] MFA Rules not processed for user `f80f1abf0ffa49e29e21a2b59b12330a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:41.152559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:41.218456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1235/2455] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:41 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:41.585347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:41.594255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4897b-289f-4fcf-abb4-bd3f017da6d5 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:41.598645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:41.599262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:41.599543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:41.599814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:41.601570 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:41.610984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:41.612449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:41.620608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1221/2456] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:41 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:41.945458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:41.946930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:42.022669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95820151-cddc-42be-8837-d67bb1a39d39 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:42.027888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:42.028653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:42.029010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:42.029276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:42.031130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:42.043673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:42.045341 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:42.056909 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1236/2457] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:41 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:42.252748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:42.254130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:42.268783 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07937-8be4-4b75-9850-94a39f14e6b2 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:42.275459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:42.276195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:42.276450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:42.276726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:42.278849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:42.292906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:42.294605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706f7cf-3aec-49c5-a632-4ca1de30271b service placement] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:42.304206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1222/2458] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:42 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:45.283871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:45.436258 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666737f-4338-46c4-94f0-06508a03942f service placement] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:45.449415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:45.450743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:45.450743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:45.450996 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] PATH_INFO: `/v3/users/e891180d99124077855af9fbc631cd94` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:45.453369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e891180d99124077855af9fbc631cd94)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:45.455350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:45.521026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e891180d99124077855af9fbc631cd94'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:45.531924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e891180d99124077855af9fbc631cd94'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:45.533168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e891180d99124077855af9fbc631cd94'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:45.548898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e891180d99124077855af9fbc631cd94'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:45.558480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e891180d99124077855af9fbc631cd94'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:45.570611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1237/2459] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:45:45 2021] DELETE /identity/v3/users/e891180d99124077855af9fbc631cd94 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:45.576668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:45.577260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:45.577407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:45.601220 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:45.618092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:45.732679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1223/2460] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:45.741611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:45.746083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:45.815069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac80b-81d6-46df-9daa-cb971b20718b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:45.819813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:45.820526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:45.820807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:45.821084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:45.842332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:45.844052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:45.856526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1238/2461] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:45:46.442971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:46.444864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:46.539806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b434-b1ec-4717-8209-91f04d9640d4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:46.547086 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:46.548166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:46.548637 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:46.548982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:46.552459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:46.634306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:46.636285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096d66-c64a-4796-b3c0-e2005814b6e6 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:46.647613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1224/2462] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:45:46 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:45:46.819428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:46.822786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:46.839327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e0ac-f5d3-4f74-a021-1f56eb6605b0 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:46.845739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:46.848451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:46.848718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:46.849225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] PATH_INFO: `/v3/projects/b963c5bbc6134869ad5ec4cb0e530c69` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:46.850706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b963c5bbc6134869ad5ec4cb0e530c69)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:46.853099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:46.943993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b963c5bbc6134869ad5ec4cb0e530c69', 'request_id': 'req-65fd1d57-e878-42a5-a23b-e6d37c6b9527'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:46.953050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b963c5bbc6134869ad5ec4cb0e530c69', 'request_id': 'req-65fd1d57-e878-42a5-a23b-e6d37c6b9527'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:46.964764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b963c5bbc6134869ad5ec4cb0e530c69', 'request_id': 'req-65fd1d57-e878-42a5-a23b-e6d37c6b9527'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:46.978263 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] The token cache is being invalidate because project b963c5bbc6134869ad5ec4cb0e530c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:45:46.978550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:46.979780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-65fd1d57-e878-42a5-a23b-e6d37c6b9527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:45:46.981137 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1239/2463] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:45:46 2021] DELETE /identity/v3/projects/b963c5bbc6134869ad5ec4cb0e530c69 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:45:52.543914 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:52.544495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:52.544495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:52.562053 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] MFA Rules not processed for user `abce52cb36c6462c98204d6e0846857a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:52.563276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:52.623455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1225/2464] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:45:52 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:57.633877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:57.634371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:57.634737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:57.653469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:45:57.655054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:57.763592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1240/2465] 10.222.0.66 () {58 vars in 968 bytes} [Tue Jul 13 08:45:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:45:57.845511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:45:57.847976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:45:57.944915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f06d0-0a70-4abe-90c1-dc3d5d7ffc95 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:45:57.950555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:45:57.951252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:45:57.951536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:45:57.951812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:45:57.961326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:45:57.963227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:45:57.973459 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1226/2466] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:45:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:46:06.225850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:06.228899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:06.346516 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b1da2-4cab-4596-bc85-7f89aeba32b9 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:06.355526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:06.357005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:06.357525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:06.358045 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] PATH_INFO: `/v3/users/63c27996c23541bb92fab4e184bea407` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:06.360135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c27996c23541bb92fab4e184bea407)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:06.365227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:06.425380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c27996c23541bb92fab4e184bea407'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.432920 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c27996c23541bb92fab4e184bea407'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.433641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c27996c23541bb92fab4e184bea407'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.446039 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c27996c23541bb92fab4e184bea407'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.454186 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c27996c23541bb92fab4e184bea407'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.461600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1241/2467] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:46:06 2021] DELETE /identity/v3/users/63c27996c23541bb92fab4e184bea407 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:06.681901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:06.695488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e9c5e-311e-4342-9056-303270b2c4d1 service swift] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:06.795018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:06.796494 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:06.796870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:06.797318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] PATH_INFO: `/v3/projects/67cbac86d97d489eb40a43295448932f` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:06.798782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cbac86d97d489eb40a43295448932f)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:06.802084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:06.861262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cbac86d97d489eb40a43295448932f', 'request_id': 'req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.868673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cbac86d97d489eb40a43295448932f', 'request_id': 'req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.877742 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cbac86d97d489eb40a43295448932f', 'request_id': 'req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.891523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] The token cache is being invalidate because project 67cbac86d97d489eb40a43295448932f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:46:06.891990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.892481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:06.895302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1227/2468] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:46:06 2021] DELETE /identity/v3/projects/67cbac86d97d489eb40a43295448932f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:06.899607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:06.900957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:06.912839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915799f0-147a-4b58-9239-f11291b19e04 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:06.968472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:06.969348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:06.969638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:06.969918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] PATH_INFO: `/v3/users/f0bf3b502d9c4a7dbc026388c06c1ca7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:06.971110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bf3b502d9c4a7dbc026388c06c1ca7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:06.973113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.019782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bf3b502d9c4a7dbc026388c06c1ca7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.026504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bf3b502d9c4a7dbc026388c06c1ca7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.027223 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bf3b502d9c4a7dbc026388c06c1ca7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.039494 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bf3b502d9c4a7dbc026388c06c1ca7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.048631 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-cfad51b5-c63b-4c0f-befd-8e9f7a3915c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bf3b502d9c4a7dbc026388c06c1ca7'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.055652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1242/2469] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:46:06 2021] DELETE /identity/v3/users/f0bf3b502d9c4a7dbc026388c06c1ca7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:07.232100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.233606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:07.256235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd6b6f-6a13-4cd5-a864-c886e9dc8ed4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.312512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.313144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.314120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.314403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] PATH_INFO: `/v3/projects/07d87b8ac3fa4e0eb1245d985842a0f6` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.316536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d87b8ac3fa4e0eb1245d985842a0f6)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.318481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.372074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d87b8ac3fa4e0eb1245d985842a0f6', 'request_id': 'req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.379436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d87b8ac3fa4e0eb1245d985842a0f6', 'request_id': 'req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.389153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d87b8ac3fa4e0eb1245d985842a0f6', 'request_id': 'req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.408065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] The token cache is being invalidate because project 07d87b8ac3fa4e0eb1245d985842a0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:46:07.408484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.410294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f2ece2e2-aede-4693-a9a0-4bb55ddc569a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:46:07.416352 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1228/2470] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:46:07 2021] DELETE /identity/v3/projects/07d87b8ac3fa4e0eb1245d985842a0f6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:07.418299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.418776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.419117 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.443535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:07.444969 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:07.512570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1243/2471] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:07.523433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.524188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.525068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.545074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:07.546357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:07.554778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1229/2472] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:07.559166 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.569047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0562b-3c7c-47d9-bb9d-ecbf12df7489 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.573450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.574112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.574392 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.574664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.575415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 08:46:07.575718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.577340 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.591781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1244/2473] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 08:46:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 08:46:07.595930 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.606152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7590df-b9d2-4363-9630-eb02043c1825 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.611405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.612087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.612493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.612888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.613587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.615544 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.657846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1230/2474] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:46:07 2021] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:46:07.663087 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.678339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608de976-ec25-443d-84aa-c64b63f96f37 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.741923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.742588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.742874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.743179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.743868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.746071 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.770774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1245/2475] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:46:07 2021] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:46:07.774513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.784390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45d60-cd58-4fba-b5f5-8a7e21369307 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.789864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.790809 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.791336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.791795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.792830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.794795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.807144 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1231/2476] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:46:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:46:07.810897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.822373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132377a-6f4f-4966-b5e0-50cdf9546841 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.830415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddf5ba-4c75-45c5-94c8-83491e958fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.831835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf5ba-4c75-45c5-94c8-83491e958fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.832609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf5ba-4c75-45c5-94c8-83491e958fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.832609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddf5ba-4c75-45c5-94c8-83491e958fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.834046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddf5ba-4c75-45c5-94c8-83491e958fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.836686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddf5ba-4c75-45c5-94c8-83491e958fa6 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.845891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1246/2477] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:46:07 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:46:07.849990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.859535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1a15-43a8-4bb5-bd11-17b0e4c55e95 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:07.864731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:07.865611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.865892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.866159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] PATH_INFO: `/v3/projects/dc57daf10f804ec7ab1235d0a2a103a2/users/4af115b9b93247458f0b3b63b7581db7/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.890340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc57daf10f804ec7ab1235d0a2a103a2, user_id=4af115b9b93247458f0b3b63b7581db7, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:07.902512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:07.927962 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1232/2478] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:46:07 2021] PUT /identity/v3/projects/dc57daf10f804ec7ab1235d0a2a103a2/users/4af115b9b93247458f0b3b63b7581db7/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:07.929771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf806-c797-432d-9a24-053139218216 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:07.930064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf806-c797-432d-9a24-053139218216 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:07.930404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf806-c797-432d-9a24-053139218216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:07.951043 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-302cf806-c797-432d-9a24-053139218216 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:07.952224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-302cf806-c797-432d-9a24-053139218216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:07.966519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:07.968335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:08.020776 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1247/2479] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:08.031729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf806-c797-432d-9a24-053139218216 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:08.032327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee8b8-2047-4138-ad37-6685041ca7e5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:08.036356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:08.037076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:08.037444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:08.037782 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:08.040861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:08.042700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf806-c797-432d-9a24-053139218216 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:08.046641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:08.047432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:08.047713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:08.047985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:08.053162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:08.054621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0dea5-b6a6-4de6-9797-4d385abf3733 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:08.058604 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:08.060077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:08.062978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1233/2480] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:46:08.070452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1248/2481] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:46:12.525360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:12.525866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:12.525866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:12.559350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] MFA Rules not processed for user `4af115b9b93247458f0b3b63b7581db7`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:12.560862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:12.679937 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1234/2482] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:12 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:12.684090 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:12.693256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff8d89-734e-4eb9-bddd-a202a7d2cc98 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:12.708439 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:12.709434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:12.709915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:12.710385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:12.711120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:12.713082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:12.743357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1249/2483] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 08:46:12 2021] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 08:46:12.747596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:12.760858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d19483-3927-46d5-9987-95a22a904cf8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:12.824741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:12.825473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:12.825758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:12.826139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:12.826971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:12.828909 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:12.851214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1235/2484] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 08:46:12 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 08:46:12.855348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:12.868221 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08bb59-6200-47a4-b775-7438ff022a16 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:12.873361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:12.874095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:12.874384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:12.874761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:12.875622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:12.878362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:12.895033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1250/2485] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 08:46:12.899985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:12.914996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803edae0-c988-4f06-b17d-f9d5bfb74411 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:12.920004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:12.920900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:12.921246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:12.921464 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] PATH_INFO: `/v3/projects/88e5aa99c48c4b019cb698bee80837db/users/172c263bc8474799a75cb51b7b7f19f8/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:12.943280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e5aa99c48c4b019cb698bee80837db, user_id=172c263bc8474799a75cb51b7b7f19f8, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:12.945956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:12.961251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1236/2486] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:46:12 2021] PUT /identity/v3/projects/88e5aa99c48c4b019cb698bee80837db/users/172c263bc8474799a75cb51b7b7f19f8/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:12.965575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:12.976680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d96fc-c388-4fb3-8c83-ee96d92083d2 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:13.036841 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331397f9-b6a7-4628-b1ea-9d6bdb165113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:13.037678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331397f9-b6a7-4628-b1ea-9d6bdb165113 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:13.037964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331397f9-b6a7-4628-b1ea-9d6bdb165113 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:13.038242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331397f9-b6a7-4628-b1ea-9d6bdb165113 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:13.039002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331397f9-b6a7-4628-b1ea-9d6bdb165113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:13.040628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331397f9-b6a7-4628-b1ea-9d6bdb165113 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:13.052719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1251/2487] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 08:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 08:46:13.056601 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:13.068568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b683e-89a2-4b56-a7f7-bb993067b778 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:13.074334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:13.075282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:13.075563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:13.075840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] PATH_INFO: `/v3/projects/88e5aa99c48c4b019cb698bee80837db/users/172c263bc8474799a75cb51b7b7f19f8/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:13.077883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e5aa99c48c4b019cb698bee80837db, user_id=172c263bc8474799a75cb51b7b7f19f8, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:13.087202 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:13.121096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1237/2488] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 08:46:13 2021] PUT /identity/v3/projects/88e5aa99c48c4b019cb698bee80837db/users/172c263bc8474799a75cb51b7b7f19f8/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:46:18.595295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2c10-7fb0-4ff2-8ece-0ea5de65f7ec None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:18.595808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2c10-7fb0-4ff2-8ece-0ea5de65f7ec None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:18.597099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2c10-7fb0-4ff2-8ece-0ea5de65f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:18.654509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-066d2c10-7fb0-4ff2-8ece-0ea5de65f7ec None None] MFA Rules not processed for user `172c263bc8474799a75cb51b7b7f19f8`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:18.656102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-066d2c10-7fb0-4ff2-8ece-0ea5de65f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:18.754710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1252/2489] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:18 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:18.766472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:18.768446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:18.943555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4540d-51ab-44a2-85b9-e9e92258fec6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:18.961310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:18.962175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:18.962465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:18.962786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:19.046407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:19.048058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:19.057430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1238/2490] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:18 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:46:20.465627 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997935fb-2097-456b-81ec-d8f34a1aba6b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:20.466150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997935fb-2097-456b-81ec-d8f34a1aba6b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:20.466252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997935fb-2097-456b-81ec-d8f34a1aba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:20.484168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-997935fb-2097-456b-81ec-d8f34a1aba6b None None] MFA Rules not processed for user `4af115b9b93247458f0b3b63b7581db7`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:20.485330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-997935fb-2097-456b-81ec-d8f34a1aba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:20.492567 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1253/2491] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:20 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:20.963153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:20.964600 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:20.997109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31487350-f644-46a6-bbde-829eee3da5cd service nova] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:21.008265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:21.015985 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:21.016328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:21.018294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:21.020531 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:21.035006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:21.036886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02816bb0-4304-41a3-a8c9-428bf71dcc9b service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:21.048322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1239/2492] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:46:22.227446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:22.227921 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:22.228051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:22.255601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] MFA Rules not processed for user `554c84c95f1a4698b304a1f07fdb6fab`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:22.257099 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:22.317667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1254/2493] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:22 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:40.522111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:40.522626 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:40.522723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:40.539490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] MFA Rules not processed for user `5de6ce3baedc402b982fa28cf4412889`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:46:40.540661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:40.594364 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1240/2494] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 08:46:40 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:46:40.828438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:40.884273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f41d4-6c3e-4c6c-b74a-c33e7c308807 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:40.887758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:40.888406 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:40.888690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:40.888967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:40.890703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:40.900794 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:40.902426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:40.910831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1255/2495] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:40 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:46:41.791745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:41.809225 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9ca5-5316-45e0-a8f8-6b3ee04e51cd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:41.814505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:41.815314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:41.815698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:41.817166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:41.819274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:41.831240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:41.833758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:41.850713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1241/2496] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:46:44.601942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:46:44.619480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4131e5-4c8c-4289-b665-688feb41340f service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:46:44.636824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:46:44.637757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:46:44.639213 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:46:44.639971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:46:44.642626 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:46:44.659096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:46:44.659096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c52e24-36ce-4680-a738-1cc49b0ea474 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:46:44.676585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1256/2497] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:46:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:47:02.825657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:02.834563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df747-c27b-4910-b125-2b74ed39669b service nova] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:02.837983 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:02.838615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:02.838893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:02.839197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:02.847452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:02.848890 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:02.857726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1242/2498] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:47:02 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:47:08.052283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:08.052851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:08.052851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:08.072533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:08.073887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:08.133579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1257/2499] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:47:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:47:08.186400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:08.187872 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:08.271299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a059f2-2544-46e1-b358-f90eed20255a service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:08.278521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f512f7-90eb-45f3-8d2e-c0afa665a9b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:08.279228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f512f7-90eb-45f3-8d2e-c0afa665a9b1 service swift] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:08.279510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f512f7-90eb-45f3-8d2e-c0afa665a9b1 service swift] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:08.279781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f512f7-90eb-45f3-8d2e-c0afa665a9b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:08.290765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f512f7-90eb-45f3-8d2e-c0afa665a9b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:08.293418 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f512f7-90eb-45f3-8d2e-c0afa665a9b1 service swift] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:08.303677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1243/2500] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:47:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:47:11.111526 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:11.125835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721157a-6c08-4d9b-827a-435271988f44 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:11.132056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:11.132738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:11.133026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:11.133302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:11.135102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:11.202030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:11.203766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a46e34-d90a-4f4e-80b1-75656bf19536 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:11.215384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1258/2501] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:47:11 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:47:22.365678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd1fe-5bfa-4543-91cc-0d07a32dd68e None None] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:22.366285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd1fe-5bfa-4543-91cc-0d07a32dd68e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:22.366285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd1fe-5bfa-4543-91cc-0d07a32dd68e None None] PATH_INFO: `/` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:22.368096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1244/2502] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:47:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:22.374107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c7c7-560b-4b06-972d-e129f8bfe598 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:22.374587 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c7c7-560b-4b06-972d-e129f8bfe598 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:22.374693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c7c7-560b-4b06-972d-e129f8bfe598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:22.392485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ef90c7c7-560b-4b06-972d-e129f8bfe598 None None] MFA Rules not processed for user `3b41f9cf1fe54552abe59a56251cfa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:22.394034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ef90c7c7-560b-4b06-972d-e129f8bfe598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:22.404495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1259/2503] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:47:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:47:22.418368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd1fe-5bfa-4543-91cc-0d07a32dd68e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:22.420081 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-008fd1fe-5bfa-4543-91cc-0d07a32dd68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:22.479992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd1fe-5bfa-4543-91cc-0d07a32dd68e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:22.483367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55aa4b-e81a-4fdb-871f-321832e2baef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:22.484002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55aa4b-e81a-4fdb-871f-321832e2baef service glance] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:22.484281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55aa4b-e81a-4fdb-871f-321832e2baef service glance] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:22.484574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55aa4b-e81a-4fdb-871f-321832e2baef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:22.495470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55aa4b-e81a-4fdb-871f-321832e2baef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:22.496908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55aa4b-e81a-4fdb-871f-321832e2baef service glance] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:22.507152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1245/2504] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:47:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:47:22.579993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5992-92c5-4c28-b92c-6e2a2592dd1f None None] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:22.580289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5992-92c5-4c28-b92c-6e2a2592dd1f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:22.581107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a5992-92c5-4c28-b92c-6e2a2592dd1f None None] PATH_INFO: `/` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:22.583185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1260/2505] 10.222.0.66 () {54 vars in 921 bytes} [Tue Jul 13 08:47:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 08:47:22.588084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b8c42-fb9a-41ca-b611-9c7ec52b3bb7 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:22.588558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b8c42-fb9a-41ca-b611-9c7ec52b3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:22.588834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b8c42-fb9a-41ca-b611-9c7ec52b3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:22.606675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-da1b8c42-fb9a-41ca-b611-9c7ec52b3bb7 None None] MFA Rules not processed for user `e987011ba5584a8985871401a7cc5923`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:22.607877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-da1b8c42-fb9a-41ca-b611-9c7ec52b3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:22.614322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1246/2506] 10.222.0.66 () {58 vars in 1019 bytes} [Tue Jul 13 08:47:22 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:47:22.625975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5992-92c5-4c28-b92c-6e2a2592dd1f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:22.627650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-594a5992-92c5-4c28-b92c-6e2a2592dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:22.640018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a5992-92c5-4c28-b92c-6e2a2592dd1f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:22.644036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:22.644807 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:22.645095 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:22.645374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:22.652173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:22.653628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:22.661711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1261/2507] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:47:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:47:24.439015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129282-e6da-4fc6-b2dc-e028665e043c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:24.439546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129282-e6da-4fc6-b2dc-e028665e043c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:24.439659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129282-e6da-4fc6-b2dc-e028665e043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:24.459371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6f129282-e6da-4fc6-b2dc-e028665e043c None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:24.460574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6f129282-e6da-4fc6-b2dc-e028665e043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:24.467661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1247/2508] 10.222.0.66 () {58 vars in 1010 bytes} [Tue Jul 13 08:47:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:47:24.480555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:24.493150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc98fa-da6f-4f24-8809-d5da83d2885d service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:24.498305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:24.498999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:24.499285 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:24.499560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:24.507714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:24.509292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:24.516637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1262/2509] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:47:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:47:38.888239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:38.888768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:38.888768 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:38.905674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] MFA Rules not processed for user `6ace03f84bc34083bab532ff1e84f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 08:47:38.906826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:47:38.914025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1248/2510] 10.222.0.66 () {58 vars in 968 bytes} [Tue Jul 13 08:47:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 08:47:38.925958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:47:38.936175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1a5e9-809c-4c60-90dc-9aec7e677d43 service swift] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:47:38.940873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd1472455034b3884be9c92d21c591f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:47:38.941504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:47:38.941778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:47:38.942048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:47:38.949639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:47:38.951243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:47:38.959282 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1263/2511] 10.222.0.66 () {60 vars in 1385 bytes} [Tue Jul 13 08:47:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 08:48:23.949590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:48:23.951133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:24.009263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644eedc-aee4-49ea-9faf-793a6b97218d None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:48:24.013485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:48:24.014291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:48:24.014581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:48:24.014861 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:48:24.016633 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:48:24.028121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:48:24.029579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:48:24.039016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1249/2512] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:48:23 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 08:49:07.012788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:49:07.014187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:07.081651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c815-74b3-4d5b-9a13-76e782a48ca7 service swift] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:49:07.086935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:49:07.087652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:49:07.087857 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:49:07.088139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:49:07.089943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:49:07.100771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:49:07.102451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:49:07.111669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1264/2513] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:49:07 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:29.828345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:29.829709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:29.839802 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1cbb-a4fc-4fe4-ad8d-26c2ba5827d2 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:29.843254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:29.843887 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:29.844170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:29.844447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:29.846094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:29.856188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:29.857621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:29.867272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1250/2514] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:50:29 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:37.777733 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:37.787292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03a38d-4707-4669-8a38-b8a2fc5bf1e9 service placement] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:37.790646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:37.791313 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:37.791599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:37.791884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:37.793578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:37.806317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:37.807773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:37.817821 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1265/2515] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:50:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:39.039369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:39.048116 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f8df4-4fa8-43bd-8fee-c410c0005668 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:39.052381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:39.053013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:39.053300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:39.053579 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:39.055288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:39.067468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:39.068898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:39.078772 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1251/2516] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:50:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:50:46.606764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:50:46.616660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1db0-0b9e-4bed-b979-4b8ae612b238 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:50:46.620077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:50:46.620711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:50:46.620990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:50:46.621265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:50:46.623041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:50:46.701128 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:50:46.702566 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:50:46.719752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1266/2517] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:50:46 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:51:19.176785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:51:19.185104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da4376-510d-42f0-9373-de2d3c36ee4a service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:51:19.188541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:51:19.189171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:51:19.189449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:51:19.189751 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:51:19.198545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:51:19.200032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:51:19.208936 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1252/2518] 10.222.0.66 () {60 vars in 1397 bytes} [Tue Jul 13 08:51:19 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3391 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:52:04.749357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:04.758200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b8773-6eb9-4d18-b98c-773f0b55d21e service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:04.761671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:04.762305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:04.762591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:04.762866 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:04.769875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:04.771359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:04.778714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1267/2519] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:52:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:52:11.453393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:52:11.462458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f994d-3b01-411f-a9a0-9e95e1a9420c service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:52:11.465895 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:52:11.466527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:52:11.466812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:52:11.467133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:52:11.475729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:52:11.477162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:52:11.503595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1253/2520] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:52:11 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:53:23.688713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:53:23.697630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541b2e1-d850-46be-b34f-d10da8dbee0e service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:53:23.701328 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:53:23.701963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:53:23.702245 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:53:23.702522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:53:23.710493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:53:23.711942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:53:23.738749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1268/2521] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:53:23 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:54:13.019661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:54:13.021059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:54:13.103740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48dc54-6a8f-4111-9053-25ccdbd34504 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:54:13.109135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:54:13.109769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:54:13.110302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:54:13.110572 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:54:13.118614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:54:13.120256 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:54:13.129252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1254/2522] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:54:13 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:55:04.256598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:55:04.332042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcd646-20dd-44d8-b7c9-db29479d8b58 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:55:04.337868 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:55:04.338864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:55:04.339382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:55:04.339665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:55:04.352034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:55:04.353664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:55:04.382977 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1269/2523] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:55:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:55:39.432710 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:55:39.451957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b73543-6208-4eef-843a-8ab14c288bcc service placement] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:55:39.455381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:55:39.456003 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:55:39.456283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:55:39.456551 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:55:39.466025 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:55:39.467589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:55:39.477614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1255/2524] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:55:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:55:40.622036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:55:40.632014 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93120-8eef-483f-b6ca-64d832b5000d service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:55:40.635394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:55:40.636018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:55:40.636297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:55:40.636571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:55:40.646063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:55:40.647545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:55:40.657286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1270/2525] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:55:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:56:19.523431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:56:19.524848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:19.601537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa983c-4640-48ea-9999-5cd2c8b64cd3 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:56:19.606680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:56:19.607343 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:56:19.608167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:56:19.608437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:56:19.610457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:56:19.692084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:56:19.693668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:56:19.710299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1256/2526] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:56:19 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:05.577109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:05.598899 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd80b0-17e0-4d58-9c68-7b211075ad1e service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:05.602389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:05.603068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:05.603355 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:05.603632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:05.667281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:05.668726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:05.686317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1271/2527] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:57:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:05.791486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:05.800875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898201ad-9969-4a2f-8802-9ae74ce7d531 service nova] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:05.804288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:05.804924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:05.805207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:05.805487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:05.813719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:05.815176 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:05.823542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1257/2528] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:57:05 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:08.031050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:08.033579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:08.102579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248f4f0-57fe-4a2e-a8f1-d892f28284d7 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:08.106010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:08.106653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:08.106958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:08.107239 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:08.109333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:08.191649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:08.193010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:08.210692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1272/2529] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:57:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:09.683221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:09.693334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7503e3-aa68-4eba-94f6-c611d46e5149 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:09.697046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:09.697888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:09.698169 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:09.698435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:09.700521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:09.709953 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:09.711437 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:09.719666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1258/2530] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:57:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:12.300586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:12.310692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4f482-3fa8-492d-a217-3d953cd00462 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:12.316632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:12.317290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:12.317575 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:12.317846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:12.319915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:12.401943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:12.403396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:12.413725 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1273/2531] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:57:12 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:57:14.813388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:14.814935 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:14.829880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5002-47ba-410e-80b0-2b035842758b service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:14.834484 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:14.835393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:14.835674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:14.835946 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] PATH_INFO: `/v3/users/4af115b9b93247458f0b3b63b7581db7` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:14.837088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af115b9b93247458f0b3b63b7581db7)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:14.839137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:14.887049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af115b9b93247458f0b3b63b7581db7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:14.887958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af115b9b93247458f0b3b63b7581db7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:14.897629 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af115b9b93247458f0b3b63b7581db7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:14.904760 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af115b9b93247458f0b3b63b7581db7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:14.905381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af115b9b93247458f0b3b63b7581db7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:14.922681 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1259/2532] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:57:14 2021] DELETE /identity/v3/users/4af115b9b93247458f0b3b63b7581db7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 08:57:15.108188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:15.123588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19853d-24c4-4e0f-8e14-a094ccaf3690 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:15.178707 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:15.179586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:15.179870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:15.180141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] PATH_INFO: `/v3/projects/dc57daf10f804ec7ab1235d0a2a103a2` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:15.181254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc57daf10f804ec7ab1235d0a2a103a2)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:15.183182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:15.229749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc57daf10f804ec7ab1235d0a2a103a2', 'request_id': 'req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.235904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc57daf10f804ec7ab1235d0a2a103a2', 'request_id': 'req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.244384 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc57daf10f804ec7ab1235d0a2a103a2', 'request_id': 'req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.256318 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] The token cache is being invalidate because project dc57daf10f804ec7ab1235d0a2a103a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:15.256609 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.257246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.258791 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1274/2533] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:57:15 2021] DELETE /identity/v3/projects/dc57daf10f804ec7ab1235d0a2a103a2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:15.262680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:15.264076 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:15.275917 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc989f7-2d8a-421f-bd59-0a3fab25fb40 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:15.329269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:15.330052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:15.330334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:15.330599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] PATH_INFO: `/v3/users/172c263bc8474799a75cb51b7b7f19f8` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:15.343092 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=172c263bc8474799a75cb51b7b7f19f8)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:15.345138 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:15.388426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172c263bc8474799a75cb51b7b7f19f8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.389058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172c263bc8474799a75cb51b7b7f19f8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.395621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172c263bc8474799a75cb51b7b7f19f8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.402363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172c263bc8474799a75cb51b7b7f19f8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.402987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172c263bc8474799a75cb51b7b7f19f8'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.419662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1260/2534] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 08:57:15 2021] DELETE /identity/v3/users/172c263bc8474799a75cb51b7b7f19f8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:57:15.592409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:57:15.595082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:57:15.607557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0b7f-e377-4fa0-9bca-f8f519777fc0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:57:15.665879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:57:15.666737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:57:15.667050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:57:15.667330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] PATH_INFO: `/v3/projects/88e5aa99c48c4b019cb698bee80837db` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:57:15.677818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e5aa99c48c4b019cb698bee80837db)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:57:15.679765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:57:15.723061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e5aa99c48c4b019cb698bee80837db', 'request_id': 'req-ed0ac517-b455-4c80-bcbf-cfdc061564ad'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.728362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e5aa99c48c4b019cb698bee80837db', 'request_id': 'req-ed0ac517-b455-4c80-bcbf-cfdc061564ad'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.736942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e5aa99c48c4b019cb698bee80837db', 'request_id': 'req-ed0ac517-b455-4c80-bcbf-cfdc061564ad'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.748438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] The token cache is being invalidate because project 88e5aa99c48c4b019cb698bee80837db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 08:57:15.748720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.749374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 08:57:15.751508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1275/2535] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 08:57:15 2021] DELETE /identity/v3/projects/88e5aa99c48c4b019cb698bee80837db => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 08:58:22.878239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:58:22.879732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:22.948729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bfc07-6139-426e-9c2d-2300d8fb2bf0 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:58:22.995527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:58:22.996167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:58:22.996449 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:58:22.996724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:58:22.998573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:58:23.069110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:58:23.070556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:58:23.078784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1261/2536] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:58:22 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 08:59:21.966329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 08:59:21.967803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:22.032450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac517-b455-4c80-bcbf-cfdc061564ad admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 08:59:22.037542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 08:59:22.038169 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 08:59:22.038453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 08:59:22.038744 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 08:59:22.040461 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 08:59:22.050525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 08:59:22.052063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 08:59:22.060914 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1276/2537] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 08:59:21 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:00:39.419466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:39.420846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:39.473574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbdd6-1d03-4233-b912-907547d4550a service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:39.477501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:39.478136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:39.478422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:39.478699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:39.480677 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:39.547815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:39.549257 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:39.560002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1262/2538] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:00:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:00:41.297712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:00:41.299271 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:41.310670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995504d4-b8d1-48a8-9e71-3c463dd81ab3 service placement] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:00:41.314123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:00:41.314755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:00:41.315076 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:00:41.315356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:00:41.316993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:00:41.328926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:00:41.330348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:00:41.340344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1277/2539] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:00:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:08.050560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:08.059380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c057e8-bb24-4913-8191-0cae71f01da7 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:08.062862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:08.063535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:08.063923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:08.064205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:08.065894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:08.128580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:08.131000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:08.150361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1263/2540] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:01:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:09.083381 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:09.084758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:09.098057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd978a-514d-4593-8c77-1314dbe98375 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:09.105082 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b41f9cf1fe54552abe59a56251cfa7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:09.106016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:09.106559 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:09.107052 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:09.109009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:09.137491 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:09.139346 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:09.151691 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1278/2541] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:01:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:11.876496 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:11.877882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:11.893529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34e0b-2de9-45a3-beec-87f2036747ca service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:11.899723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:11.900696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:11.900858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:11.901135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] PATH_INFO: `/v3/users/f80f1abf0ffa49e29e21a2b59b12330a` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:11.902297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80f1abf0ffa49e29e21a2b59b12330a)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:11.904356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:11.953104 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80f1abf0ffa49e29e21a2b59b12330a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:11.953766 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80f1abf0ffa49e29e21a2b59b12330a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:11.960940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80f1abf0ffa49e29e21a2b59b12330a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:11.969087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80f1abf0ffa49e29e21a2b59b12330a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:11.969808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-65c9d266-0700-44d6-9e72-9b6cb6cd44c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80f1abf0ffa49e29e21a2b59b12330a'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:11.987939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1264/2542] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:01:11 2021] DELETE /identity/v3/users/f80f1abf0ffa49e29e21a2b59b12330a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:12.167545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.178538 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17f8d-d1c7-4d1d-8018-0268633382d1 service nova] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.234498 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.235390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.235673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.235946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] PATH_INFO: `/v3/projects/36d15843107e4bc39513973ab3b5be96` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.237229 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d15843107e4bc39513973ab3b5be96)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.240300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.287735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d15843107e4bc39513973ab3b5be96', 'request_id': 'req-5004584b-68d4-4db0-8101-78453fad1b68'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:12.292986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d15843107e4bc39513973ab3b5be96', 'request_id': 'req-5004584b-68d4-4db0-8101-78453fad1b68'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:12.300277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d15843107e4bc39513973ab3b5be96', 'request_id': 'req-5004584b-68d4-4db0-8101-78453fad1b68'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:12.312711 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] The token cache is being invalidate because project 36d15843107e4bc39513973ab3b5be96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:01:12.313003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:12.313659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-5004584b-68d4-4db0-8101-78453fad1b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:12.315244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1279/2543] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:01:12 2021] DELETE /identity/v3/projects/36d15843107e4bc39513973ab3b5be96 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:12.322210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.322504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.322784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.380432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:12.381589 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:12.437743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1265/2544] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:12.445663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.445891 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.446168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.463480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:12.464618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:12.472199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1280/2545] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:12.477006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.486088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5478b7-67dd-45fb-aa2a-7c20088d0877 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.492099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.492885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.493216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.493540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.494311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:01:12.494671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.496627 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.508046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1266/2546] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:01:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:01:12.512215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.520796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67cbef-7102-42f8-82dd-a83a5c9724a5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.525297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.525941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.526224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.526499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.527210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.529124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.563629 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1281/2547] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:01:12.567819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.576880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e2a28-bd2e-4a76-939c-b65062e64253 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.631203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.631868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.632156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.632434 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.633118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.635072 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.658431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1267/2548] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:01:12.659678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.671333 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55275a3-b915-43ca-b53a-1ddfc3a080ea admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.675873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.676558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.676840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.677118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.677839 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.679511 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.689741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1282/2549] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:01:12.693965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.703454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2c19-3c09-46d3-bae0-9a48f95c4e8b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.708346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf6277-2921-47bf-9f36-27491a27d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.708996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf6277-2921-47bf-9f36-27491a27d2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.709285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf6277-2921-47bf-9f36-27491a27d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.709561 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf6277-2921-47bf-9f36-27491a27d2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.710306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf6277-2921-47bf-9f36-27491a27d2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.711944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf6277-2921-47bf-9f36-27491a27d2b0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.721623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1268/2550] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:12 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:01:12.726592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.736009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9392-f1a7-4a8f-9748-d1bc08688db8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.741036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.741904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.742181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.742451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] PATH_INFO: `/v3/projects/29a2fc2104854cb09d11ff4f5094a6ee/users/83e66e04cc2e4051b1853cb43cdae6b5/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.758311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a2fc2104854cb09d11ff4f5094a6ee, user_id=83e66e04cc2e4051b1853cb43cdae6b5, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.760975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.774772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1283/2551] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:01:12 2021] PUT /identity/v3/projects/29a2fc2104854cb09d11ff4f5094a6ee/users/83e66e04cc2e4051b1853cb43cdae6b5/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:12.785505 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.786709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.786709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.817018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] MFA Rules not processed for user `83e66e04cc2e4051b1853cb43cdae6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:12.818411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:12.879642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1269/2552] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:01:12.884306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.943160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12df4-4d72-482d-b7a3-11f44ee201a4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:12.947852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:12.948509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:12.948790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:12.949107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:12.949805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:12.951764 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:12.982564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1284/2553] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:01:12.983765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:12.994368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f51e6-3ab3-4746-9b19-7dc22766464e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:13.047586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:13.048250 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:13.048533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:13.048807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:13.049488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:13.051432 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:13.071326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1270/2554] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:01:12 2021] POST /identity/v3/users => generated 308 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:01:13.075331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:13.085493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364730d6-d37f-4376-a8d3-5d22df1c6e87 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:13.090182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:13.090840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:13.091161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:13.091430 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:13.092361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:13.093962 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:13.105603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1285/2555] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:01:13.109860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:13.119351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577ea79-7e61-4759-9dab-69c81c03c277 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:13.123697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:13.124612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:13.125398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:13.125398 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] PATH_INFO: `/v3/projects/669688b9cadf4c3c8dedd42ac8dae6de/users/1fc2e3f2073d4a90b3cb93123257fbcd/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:13.140470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=669688b9cadf4c3c8dedd42ac8dae6de, user_id=1fc2e3f2073d4a90b3cb93123257fbcd, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:13.143217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:13.158024 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1271/2556] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:01:13 2021] PUT /identity/v3/projects/669688b9cadf4c3c8dedd42ac8dae6de/users/1fc2e3f2073d4a90b3cb93123257fbcd/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:13.161912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:13.171232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803701c-0979-4d93-99ec-14db67d7a3e0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:13.228983 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d5847-8b2a-4eb6-b6a0-a0018a86d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:13.229748 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5847-8b2a-4eb6-b6a0-a0018a86d5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:13.230027 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5847-8b2a-4eb6-b6a0-a0018a86d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:13.230299 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5847-8b2a-4eb6-b6a0-a0018a86d5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:13.231079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d5847-8b2a-4eb6-b6a0-a0018a86d5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:13.232634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d5847-8b2a-4eb6-b6a0-a0018a86d5b5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:13.245322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1286/2557] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:13 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:01:13.246698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:13.256773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345787-2b22-4489-9d01-02c2cdf04aeb admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:13.261052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:13.261917 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:13.262194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:13.262460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] PATH_INFO: `/v3/projects/669688b9cadf4c3c8dedd42ac8dae6de/users/1fc2e3f2073d4a90b3cb93123257fbcd/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:13.264670 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=669688b9cadf4c3c8dedd42ac8dae6de, user_id=1fc2e3f2073d4a90b3cb93123257fbcd, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:13.267752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:13.279014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1272/2558] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:01:13 2021] PUT /identity/v3/projects/669688b9cadf4c3c8dedd42ac8dae6de/users/1fc2e3f2073d4a90b3cb93123257fbcd/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:13.289093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:13.289394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:13.289664 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:13.315279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] MFA Rules not processed for user `1fc2e3f2073d4a90b3cb93123257fbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:13.316449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:13.383265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1287/2559] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:13 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:55.928075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:55.930978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:55.988708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b234787-d469-4745-bbdb-784eb225fb1b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:55.992204 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46926e9a-772e-4a17-9fac-338e3b7a8475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:55.992863 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46926e9a-772e-4a17-9fac-338e3b7a8475 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:55.993148 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46926e9a-772e-4a17-9fac-338e3b7a8475 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:55.993426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46926e9a-772e-4a17-9fac-338e3b7a8475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:56.002512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46926e9a-772e-4a17-9fac-338e3b7a8475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:56.004750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46926e9a-772e-4a17-9fac-338e3b7a8475 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:56.015161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1273/2560] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:01:55 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:56.138335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:56.195646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41734b6-ec3b-400e-aa95-3226a5073f12 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:56.200150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:56.200967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:56.201252 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:56.201530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] PATH_INFO: `/v3/users/83e66e04cc2e4051b1853cb43cdae6b5` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:56.202689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e66e04cc2e4051b1853cb43cdae6b5)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:56.204682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:56.254822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e66e04cc2e4051b1853cb43cdae6b5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.261661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e66e04cc2e4051b1853cb43cdae6b5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.262453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e66e04cc2e4051b1853cb43cdae6b5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.276827 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e66e04cc2e4051b1853cb43cdae6b5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.285317 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e66e04cc2e4051b1853cb43cdae6b5'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.292332 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1288/2561] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:01:56 2021] DELETE /identity/v3/users/83e66e04cc2e4051b1853cb43cdae6b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:56.297019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:56.297306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:56.297584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:56.319996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:56.321199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:56.386662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1274/2562] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:56.397642 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:56.399124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:56.460591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ef908-5e6a-4b55-a335-f8c45ab1c5f0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:56.464864 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:56.465869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:56.466298 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:56.466705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:56.476793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:56.478241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:56.487257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1289/2563] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:01:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:56.761838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:56.763941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:56.775611 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ed1bb-f57a-4171-a65d-279ab3dce726 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:56.780708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:56.781039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:56.781318 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:56.781586 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] PATH_INFO: `/v3/projects/29a2fc2104854cb09d11ff4f5094a6ee` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:56.782714 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a2fc2104854cb09d11ff4f5094a6ee)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:56.785157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:56.836684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a2fc2104854cb09d11ff4f5094a6ee', 'request_id': 'req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.841943 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a2fc2104854cb09d11ff4f5094a6ee', 'request_id': 'req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.850117 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a2fc2104854cb09d11ff4f5094a6ee', 'request_id': 'req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.861850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] The token cache is being invalidate because project 29a2fc2104854cb09d11ff4f5094a6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:01:56.862160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.862820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:56.865063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1275/2564] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:01:56 2021] DELETE /identity/v3/projects/29a2fc2104854cb09d11ff4f5094a6ee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:56.868987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:56.877828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e5140-2eed-45fa-b9f5-95a2be885016 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:56.935021 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:56.936259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:56.936548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:56.936980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] PATH_INFO: `/v3/users/1fc2e3f2073d4a90b3cb93123257fbcd` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:56.938769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc2e3f2073d4a90b3cb93123257fbcd)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:56.944327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:56.997593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc2e3f2073d4a90b3cb93123257fbcd'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.004966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc2e3f2073d4a90b3cb93123257fbcd'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.005729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc2e3f2073d4a90b3cb93123257fbcd'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.024947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc2e3f2073d4a90b3cb93123257fbcd'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.032678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-53a66b92-9a34-49ee-aca0-75d1cdb20493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc2e3f2073d4a90b3cb93123257fbcd'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.039371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1290/2565] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:01:56 2021] DELETE /identity/v3/users/1fc2e3f2073d4a90b3cb93123257fbcd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:57.337029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.338516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:57.352942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb03a-1d96-4067-9fe1-c5d23ca1fad4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.423529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.424400 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.424686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.424966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] PATH_INFO: `/v3/projects/669688b9cadf4c3c8dedd42ac8dae6de` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.426854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669688b9cadf4c3c8dedd42ac8dae6de)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.428830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.492159 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669688b9cadf4c3c8dedd42ac8dae6de', 'request_id': 'req-35fb31d1-40ad-4008-aea5-8bfebaf7a519'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.498944 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669688b9cadf4c3c8dedd42ac8dae6de', 'request_id': 'req-35fb31d1-40ad-4008-aea5-8bfebaf7a519'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.508713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669688b9cadf4c3c8dedd42ac8dae6de', 'request_id': 'req-35fb31d1-40ad-4008-aea5-8bfebaf7a519'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.521718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] The token cache is being invalidate because project 669688b9cadf4c3c8dedd42ac8dae6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:01:57.522011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.522646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-35fb31d1-40ad-4008-aea5-8bfebaf7a519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:57.524212 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1276/2566] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:01:57 2021] DELETE /identity/v3/projects/669688b9cadf4c3c8dedd42ac8dae6de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:57.530477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.531046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.531208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.549466 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:57.551409 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:57.616721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1291/2567] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:57.624934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.625223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.625499 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.645640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:57.647018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:57.655235 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1277/2568] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:57.660300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.669424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd35c-df96-4d51-af0c-60dcc6f5d1d5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.673769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.674428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.674709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.675017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.676368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:01:57.676679 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.678279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.689780 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1292/2569] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:01:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:01:57.695926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.704850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14ca08-47df-47ee-b07d-07b42ede354f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.709447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.710095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.710375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.710646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.711349 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.713253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.739430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1278/2570] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:01:57 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:01:57.743758 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.752844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd680-ab0d-42ed-b5fb-25db4894c7a5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.806428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.807109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.807390 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.807661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.808358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.810261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.829708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1293/2571] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:01:57 2021] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:01:57.834029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.844762 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1fe1-b816-495a-904b-497e85b3dff1 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.849385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.850069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.850362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.850636 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.851396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.853002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.864037 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1279/2572] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:01:57.868102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.877240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a7e9-2c3c-4662-9c14-de00662367a5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.882311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3b72-2e9c-483c-a44c-1e1ff03767ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.882999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3b72-2e9c-483c-a44c-1e1ff03767ce admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.883280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3b72-2e9c-483c-a44c-1e1ff03767ce admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.883653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3b72-2e9c-483c-a44c-1e1ff03767ce admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.884276 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3b72-2e9c-483c-a44c-1e1ff03767ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.885863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3b72-2e9c-483c-a44c-1e1ff03767ce admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.897456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1294/2573] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:01:57.901896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:57.911502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d63a85-9296-4d6a-91df-973ac2be54ef admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:57.915989 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:57.916860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.917135 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.917407 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] PATH_INFO: `/v3/projects/06f5ebf161cb44848c1993c6f12571d6/users/b0b5cd1da9a94178974c722571829860/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.931918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f5ebf161cb44848c1993c6f12571d6, user_id=b0b5cd1da9a94178974c722571829860, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:57.934549 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:57.947769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1280/2574] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:01:57 2021] PUT /identity/v3/projects/06f5ebf161cb44848c1993c6f12571d6/users/b0b5cd1da9a94178974c722571829860/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:01:57.959050 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:57.959347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:57.959622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:57.984810 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] MFA Rules not processed for user `b0b5cd1da9a94178974c722571829860`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:57.985961 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.049923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1295/2575] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:01:58.055244 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.114293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bcd41-6c74-4872-b113-c2ed2fb038dc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.117888 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.118545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.118832 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.119153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.119855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.121763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.146114 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1281/2576] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:01:58 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:01:58.150354 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.160747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a208-7db5-4ec5-ad60-ebc9714b260c None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.212378 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.213036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.213315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.213588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.214295 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.216220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.236837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1296/2577] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:01:58 2021] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:01:58.241856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.251995 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44da1-cd5c-41ce-a8ac-c816ee27d653 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.256536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.257194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.257478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.257757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.258473 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.260119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.270824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1282/2578] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:58 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:01:58.275101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.284182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9b1a-6309-4832-8e39-4c988ddb73ed admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.289106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.290000 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.290279 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.290552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] PATH_INFO: `/v3/projects/85ff417600da4cfd90b29d505d9de296/users/3c0e030908874181b90be7faa6451fb5/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.305216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ff417600da4cfd90b29d505d9de296, user_id=3c0e030908874181b90be7faa6451fb5, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.307950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.321019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1297/2579] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:01:58 2021] PUT /identity/v3/projects/85ff417600da4cfd90b29d505d9de296/users/3c0e030908874181b90be7faa6451fb5/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:01:58.324987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.334123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648e76a-0ba2-4d3c-a7a9-f238bef8be28 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.388166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec9983-6a17-43b3-867d-e2fdd84f07f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.388819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec9983-6a17-43b3-867d-e2fdd84f07f9 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.389099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec9983-6a17-43b3-867d-e2fdd84f07f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.389373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec9983-6a17-43b3-867d-e2fdd84f07f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.390089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec9983-6a17-43b3-867d-e2fdd84f07f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.391761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec9983-6a17-43b3-867d-e2fdd84f07f9 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.401724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1283/2580] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:01:58 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:01:58.406176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.416305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c269c6-6f79-4da3-9756-2719a1fa240e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.420638 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.421514 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.421792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.422067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] PATH_INFO: `/v3/projects/85ff417600da4cfd90b29d505d9de296/users/3c0e030908874181b90be7faa6451fb5/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.423905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ff417600da4cfd90b29d505d9de296, user_id=3c0e030908874181b90be7faa6451fb5, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.426700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.437072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1298/2581] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:01:58 2021] PUT /identity/v3/projects/85ff417600da4cfd90b29d505d9de296/users/3c0e030908874181b90be7faa6451fb5/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:01:58.447460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.447753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.448036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.474680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] MFA Rules not processed for user `3c0e030908874181b90be7faa6451fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:58.475869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.540111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1284/2582] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:58 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:58.549986 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.552487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.606842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67368df7-2438-4bf0-ba6a-96bb38e06937 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.610692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a044d-eeff-4430-8cdc-faa556c5315a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.611383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a044d-eeff-4430-8cdc-faa556c5315a service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.611670 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a044d-eeff-4430-8cdc-faa556c5315a service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.611949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a044d-eeff-4430-8cdc-faa556c5315a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.621574 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a044d-eeff-4430-8cdc-faa556c5315a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.623048 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a044d-eeff-4430-8cdc-faa556c5315a service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.632671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1299/2583] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:01:58 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:58.659363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.718088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f077a-7c15-4e3e-9728-bc603307944c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.722445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.723342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.723624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.723923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] PATH_INFO: `/v3/users/b0b5cd1da9a94178974c722571829860` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.725071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b5cd1da9a94178974c722571829860)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.727020 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.773686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b5cd1da9a94178974c722571829860'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:58.774272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b5cd1da9a94178974c722571829860'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:58.780794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b5cd1da9a94178974c722571829860'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:58.788606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b5cd1da9a94178974c722571829860'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:58.789273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b5cd1da9a94178974c722571829860'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:58.806602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1285/2584] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:01:58 2021] DELETE /identity/v3/users/b0b5cd1da9a94178974c722571829860 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:58.811230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.811449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.811729 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.828489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:58.829648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.885199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1300/2585] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:01:58.894865 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:58.896260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:58.951162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294d2e7-499b-44e7-a361-4c18433e32d6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:58.954696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:58.955369 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:58.955651 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:58.955929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:58.964533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:58.965969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:58.975299 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1286/2586] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:01:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:01:59.254065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:59.255469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:59.266345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1c10b-2964-4c04-9398-c590a6c1bc73 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:59.271541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:59.272400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:59.272772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:59.273047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] PATH_INFO: `/v3/projects/06f5ebf161cb44848c1993c6f12571d6` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:59.274167 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f5ebf161cb44848c1993c6f12571d6)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:59.276110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:59.320156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f5ebf161cb44848c1993c6f12571d6', 'request_id': 'req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.325242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f5ebf161cb44848c1993c6f12571d6', 'request_id': 'req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.333033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f5ebf161cb44848c1993c6f12571d6', 'request_id': 'req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.344694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] The token cache is being invalidate because project 06f5ebf161cb44848c1993c6f12571d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:01:59.344977 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.345607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.347760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1301/2587] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:01:59 2021] DELETE /identity/v3/projects/06f5ebf161cb44848c1993c6f12571d6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:59.351818 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:59.360917 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c46eeb-6573-40e8-9ea1-3cb6ebe209cd service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:59.413862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:59.414721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:59.415031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:59.415309 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] PATH_INFO: `/v3/users/3c0e030908874181b90be7faa6451fb5` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:59.416442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0e030908874181b90be7faa6451fb5)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:59.418367 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:59.461556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0e030908874181b90be7faa6451fb5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.462217 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0e030908874181b90be7faa6451fb5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.468932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0e030908874181b90be7faa6451fb5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.476371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0e030908874181b90be7faa6451fb5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.476977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d95ae45c-7b50-46c0-8893-5e480e6e7e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0e030908874181b90be7faa6451fb5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.493981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1287/2588] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:01:59 2021] DELETE /identity/v3/users/3c0e030908874181b90be7faa6451fb5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:59.805296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:01:59.805296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:01:59.810904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6f54-bec0-4b30-b9e2-4ba9a2ca6728 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:01:59.874236 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:01:59.875035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:59.875320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:59.875591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] PATH_INFO: `/v3/projects/85ff417600da4cfd90b29d505d9de296` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:59.876706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ff417600da4cfd90b29d505d9de296)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:01:59.879372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:01:59.926010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ff417600da4cfd90b29d505d9de296', 'request_id': 'req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.931383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ff417600da4cfd90b29d505d9de296', 'request_id': 'req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.938412 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ff417600da4cfd90b29d505d9de296', 'request_id': 'req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.950063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] The token cache is being invalidate because project 85ff417600da4cfd90b29d505d9de296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:01:59.950353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.951013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-7d0fc6d9-0ced-4cca-a057-70baf7bf2075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:01:59.952571 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1302/2589] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:01:59 2021] DELETE /identity/v3/projects/85ff417600da4cfd90b29d505d9de296 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:01:59.958342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:01:59.958631 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:01:59.958942 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:01:59.976364 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:01:59.977546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:00.034650 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1288/2590] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:01:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:00.042646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.042972 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.043259 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.061335 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:00.062499 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:00.070394 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1303/2591] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:02:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:00.074721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.084068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551cd8-8c68-48d7-96de-29cb4a105e1a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.088348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.088994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.089278 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.089556 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.090274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:02:00.090581 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.092223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.104984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1289/2592] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:02:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:02:00.109432 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.119089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db958-905d-4a42-8538-71f89dac2425 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.123535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.124193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.124535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.125110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.125467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.127410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.153927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1304/2593] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:02:00 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:00.158096 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.168073 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba735-6a41-4cf5-92eb-f8bc032629b7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.221792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.222513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.222788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.223095 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.223785 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.225696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.246569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1290/2594] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:02:00 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:02:00.250645 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.260651 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33598c21-e617-4fb4-958f-ef41975b304a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.265019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.265668 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.265953 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.266226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.266968 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.268570 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.279795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1305/2595] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:00.283693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.293543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399c26d-b722-40a6-9780-ae41e4bc934a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.297913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2ffe-56f2-45c6-ab53-30412cbe0ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.298560 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2ffe-56f2-45c6-ab53-30412cbe0ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.298845 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2ffe-56f2-45c6-ab53-30412cbe0ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.299157 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2ffe-56f2-45c6-ab53-30412cbe0ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.299874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2ffe-56f2-45c6-ab53-30412cbe0ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.302339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2ffe-56f2-45c6-ab53-30412cbe0ad5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.311856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1291/2596] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:02:00.316022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.325114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd405b-5703-4f68-8237-97155c8abc46 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.329449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.330310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.330592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.330870 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] PATH_INFO: `/v3/projects/e3cd394d6e3046b5b11a7197468fdfb0/users/c4a6b105c3a54ce2a67163f953911aee/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.344837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cd394d6e3046b5b11a7197468fdfb0, user_id=c4a6b105c3a54ce2a67163f953911aee, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.348227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.361359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1306/2597] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:02:00 2021] PUT /identity/v3/projects/e3cd394d6e3046b5b11a7197468fdfb0/users/c4a6b105c3a54ce2a67163f953911aee/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:02:00.373226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.373523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.373801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.399562 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] MFA Rules not processed for user `c4a6b105c3a54ce2a67163f953911aee`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:02:00.400674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:00.461460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1292/2598] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:02:00 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:02:00.471859 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:00.474081 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:00.528485 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372e94-cb2a-4896-9a91-3bf4c57786f4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:00.532015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:00.532653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:00.532940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:00.533219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:00.541787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:00.543260 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:00.552175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1307/2599] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:02:00 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:05.042697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:05.053005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803faaa-1dbc-40eb-a4be-33bda9d35422 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:05.056848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:05.057539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:05.057826 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:05.058129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:05.059941 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:05.138392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:05.139877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:05.158119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1293/2600] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:02:05 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:02:05.363661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:02:05.371808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000dab8-eed4-4bd8-95b1-eb3b6896c435 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:02:05.375270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:02:05.375881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:02:05.376165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:02:05.376443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:02:05.378175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:02:05.446693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:02:05.448163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:02:05.457242 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1308/2601] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:02:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:03:23.174788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:03:23.183860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c59e-318d-439c-b407-ec70bfd81b5c service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:03:23.187390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:03:23.188032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:03:23.188314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:03:23.188602 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:03:23.190289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:03:23.249507 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:03:23.250992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:03:23.259855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1294/2602] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:03:23 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:04:25.926097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:04:25.927496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:26.038767 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac64691-cd43-4e38-b219-625962bfb582 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:04:26.043617 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:04:26.044256 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:04:26.044541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:04:26.044818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:04:26.046524 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:04:26.056823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:04:26.058395 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:04:26.067929 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1309/2603] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:04:25 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:00.381689 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:00.398822 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46397e-f623-45c6-98fd-85d8de811529 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:00.402210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:00.402830 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:00.403136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:00.403409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:00.424179 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:00.425597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:00.434173 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1295/2604] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:07:00 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:05.039458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:05.058506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa1f12-c1e0-4630-a47c-f0422d4125a8 service placement] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:05.062056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:05.062684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:05.062993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:05.063270 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:05.071083 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:05.072508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:05.080861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1310/2605] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:07:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:07:05.742172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:07:05.743587 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:07:05.764547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1818b7-08a3-408b-b65a-d2512ce9f1a3 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:07:05.767977 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:07:05.768604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:07:05.768882 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:07:05.769154 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:07:05.777910 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:07:05.779376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:07:05.787510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1296/2606] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:07:05 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:08:23.571999 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:08:23.591124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeab58d-957e-4aba-b940-ce39f4039eb6 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:08:23.594465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:08:23.595120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:08:23.595655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:08:23.595928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:08:23.603741 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:08:23.605453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:08:23.629907 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1311/2607] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:08:23 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:09:13.766440 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:13.767886 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:13.843630 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8545d7e-9d79-42d1-aed8-6951d560eeb5 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:13.847379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:13.848021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:13.848306 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:13.848583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:13.850264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:13.928847 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:13.930347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:13.948508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1297/2608] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:09:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:09:20.347487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:20.348973 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:20.364307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fc01-15f3-45b9-bce8-99e9d7512510 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:20.368894 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:20.369770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:20.370046 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:20.370349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] PATH_INFO: `/v3/users/554c84c95f1a4698b304a1f07fdb6fab` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:20.384772 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554c84c95f1a4698b304a1f07fdb6fab)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:20.386714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:20.431497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554c84c95f1a4698b304a1f07fdb6fab'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.438149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554c84c95f1a4698b304a1f07fdb6fab'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.438815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554c84c95f1a4698b304a1f07fdb6fab'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.451284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554c84c95f1a4698b304a1f07fdb6fab'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.459216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554c84c95f1a4698b304a1f07fdb6fab'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.466120 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1312/2609] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:09:20 2021] DELETE /identity/v3/users/554c84c95f1a4698b304a1f07fdb6fab => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:20.643900 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:20.660797 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59981428-0561-4b97-b187-6030d1a5a413 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:20.716015 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:20.716869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:20.717151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:20.717427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] PATH_INFO: `/v3/projects/77f6db6ace1f465f80565405509ad580` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:20.718558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f6db6ace1f465f80565405509ad580)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:20.720745 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:20.766311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f6db6ace1f465f80565405509ad580', 'request_id': 'req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.771657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f6db6ace1f465f80565405509ad580', 'request_id': 'req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.778644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f6db6ace1f465f80565405509ad580', 'request_id': 'req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.789351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] The token cache is being invalidate because project 77f6db6ace1f465f80565405509ad580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:09:20.789585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.790210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.791773 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1298/2610] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:09:20 2021] DELETE /identity/v3/projects/77f6db6ace1f465f80565405509ad580 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:20.795740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:20.797066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:20.809460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bfa17-4f1c-44cd-bd82-71f614040a79 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:20.864658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:20.865705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:20.866042 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:20.866427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] PATH_INFO: `/v3/users/145f6e73d21b401f96a8638b73bba4ee` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:20.881847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145f6e73d21b401f96a8638b73bba4ee)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:20.885090 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:20.934528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145f6e73d21b401f96a8638b73bba4ee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.941667 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145f6e73d21b401f96a8638b73bba4ee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.942345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145f6e73d21b401f96a8638b73bba4ee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.954435 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145f6e73d21b401f96a8638b73bba4ee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.963489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145f6e73d21b401f96a8638b73bba4ee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:20.970904 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1313/2611] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:09:20 2021] DELETE /identity/v3/users/145f6e73d21b401f96a8638b73bba4ee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:21.159047 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:21.160485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:21.172918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2d66-0345-4c0b-8a9b-53d91c1a7327 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:21.227752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:21.228652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:21.228939 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:21.229218 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] PATH_INFO: `/v3/projects/831e2990de3942e49ee57a05d7769b9d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:21.239345 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831e2990de3942e49ee57a05d7769b9d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:21.241699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:21.286614 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831e2990de3942e49ee57a05d7769b9d', 'request_id': 'req-2362b1f2-c461-429e-940f-c6b67db554d5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:21.292118 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831e2990de3942e49ee57a05d7769b9d', 'request_id': 'req-2362b1f2-c461-429e-940f-c6b67db554d5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:21.299088 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831e2990de3942e49ee57a05d7769b9d', 'request_id': 'req-2362b1f2-c461-429e-940f-c6b67db554d5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:21.310511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] The token cache is being invalidate because project 831e2990de3942e49ee57a05d7769b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:09:21.310795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:21.311465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:09:21.312968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1299/2612] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:09:21 2021] DELETE /identity/v3/projects/831e2990de3942e49ee57a05d7769b9d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:09:26.920661 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:09:26.921984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:26.987144 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458342e1-8be4-4182-889b-34a5b8479134 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:09:27.042578 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:09:27.043334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:09:27.043624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:09:27.043903 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:09:27.045836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:09:27.055957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:09:27.057547 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:09:27.066862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1314/2613] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:09:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:12:00.185471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:12:00.186804 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:12:00.251898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b1f2-c461-429e-940f-c6b67db554d5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:12:00.255216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:12:00.255896 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:12:00.256170 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:12:00.256443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:12:00.258106 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:12:00.320377 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:12:00.321811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:12:00.329784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1300/2614] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:12:00 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:12:05.266608 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:12:05.275377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f694f-94c3-4b8e-ac6b-ce2b48e27329 service placement] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:12:05.278753 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:12:05.279415 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:12:05.279699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:12:05.279974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:12:05.281682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:12:05.358502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:12:05.360074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:12:05.377957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1315/2615] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:12:05 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:12:05.878876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:12:05.887599 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98beaf-2c25-4c15-bf95-91caa09cc13c service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:12:05.891031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:12:05.891664 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:12:05.891949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:12:05.892222 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:12:05.893913 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:12:05.970385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:12:05.971854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273b6bf-d39e-4793-abef-7ae7492e4cda service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:12:05.989044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1301/2616] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:12:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:14:00.385998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:00.387459 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:00.447883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296d16b-9f90-4529-8979-8a22dcc88b4f service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:00.452072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:00.452923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:00.453204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:00.453475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] PATH_INFO: `/v3/users/c4a6b105c3a54ce2a67163f953911aee` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:00.466376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a6b105c3a54ce2a67163f953911aee)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:00.468320 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:00.510231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a6b105c3a54ce2a67163f953911aee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:00.516966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a6b105c3a54ce2a67163f953911aee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:00.517655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a6b105c3a54ce2a67163f953911aee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:00.529497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a6b105c3a54ce2a67163f953911aee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:00.536447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a6b105c3a54ce2a67163f953911aee'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:00.542302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1316/2617] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:14:00 2021] DELETE /identity/v3/users/c4a6b105c3a54ce2a67163f953911aee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:14:00.546730 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:00.547258 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:00.547354 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:00.572987 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:14:00.574131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:00.630029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1302/2618] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:14:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:14:00.641103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:00.642477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:00.697032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efed3c-c26f-4922-a1d4-72be12ec825b admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:00.700539 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28510cc5-28ea-427f-afad-1e7addc47c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:00.701176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28510cc5-28ea-427f-afad-1e7addc47c20 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:00.701462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28510cc5-28ea-427f-afad-1e7addc47c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:00.701742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28510cc5-28ea-427f-afad-1e7addc47c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:00.710634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28510cc5-28ea-427f-afad-1e7addc47c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:00.712111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28510cc5-28ea-427f-afad-1e7addc47c20 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:00.720939 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1317/2619] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:14:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:14:00.990743 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:00.992229 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:01.003698 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506552fa-6050-44eb-b50f-68ad73184654 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.009519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.010370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.010671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.011059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] PATH_INFO: `/v3/projects/e3cd394d6e3046b5b11a7197468fdfb0` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.012271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cd394d6e3046b5b11a7197468fdfb0)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.014191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.061137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cd394d6e3046b5b11a7197468fdfb0', 'request_id': 'req-a9527e0d-0a87-418a-8709-93c0667a2047'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:01.066293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cd394d6e3046b5b11a7197468fdfb0', 'request_id': 'req-a9527e0d-0a87-418a-8709-93c0667a2047'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:01.073839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cd394d6e3046b5b11a7197468fdfb0', 'request_id': 'req-a9527e0d-0a87-418a-8709-93c0667a2047'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:01.085074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] The token cache is being invalidate because project e3cd394d6e3046b5b11a7197468fdfb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:14:01.085353 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:01.085969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9527e0d-0a87-418a-8709-93c0667a2047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:14:01.087776 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1303/2620] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:14:00 2021] DELETE /identity/v3/projects/e3cd394d6e3046b5b11a7197468fdfb0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:14:01.094254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.094542 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.094844 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.138846 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:14:01.139933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:01.194607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1318/2621] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:14:01.202231 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.202518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.202791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.221506 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:14:01.222666 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:01.230131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1304/2622] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:14:01.234127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.243456 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623e27b-ea96-4212-ab40-2e15ea8bddbf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.247743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.248396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.248676 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.248951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.249671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:14:01.249979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.251736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.263636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1319/2623] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:14:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:14:01.267955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.277130 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834cdbd-de61-46c5-91d0-80be77124ac0 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.281483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.282123 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.282405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.282683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.283394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.285302 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.319523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1305/2624] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:14:01.323800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.332803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78f65-98b1-445d-8013-1d65cc61f402 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.387160 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.387814 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.388096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.388370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.389101 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.390981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.410373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1320/2625] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:14:01.414583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.423996 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc9f1-2cde-4d42-9e5b-7b05d209f540 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.429098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.429777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.430059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.430334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.431087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.432687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.442270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1306/2626] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:14:01.446701 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.455598 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97361-7f00-49e4-9545-74307198cdff admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.460038 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a0389-9033-474d-b118-d6823025e490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.460675 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a0389-9033-474d-b118-d6823025e490 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.460956 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a0389-9033-474d-b118-d6823025e490 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.461225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a0389-9033-474d-b118-d6823025e490 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.461933 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a0389-9033-474d-b118-d6823025e490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.463829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a0389-9033-474d-b118-d6823025e490 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.473150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1321/2627] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:14:01.476934 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.485919 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150c78-d1c0-45a9-ab84-c4902ad6db6e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.490883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.491764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.492051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.492327 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] PATH_INFO: `/v3/projects/da005a30f4b34059be6788903cc5e373/users/1cab2512e0b449e68fbac49b5d4edaca/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.506732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da005a30f4b34059be6788903cc5e373, user_id=1cab2512e0b449e68fbac49b5d4edaca, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.509391 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.522617 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1307/2628] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:14:01 2021] PUT /identity/v3/projects/da005a30f4b34059be6788903cc5e373/users/1cab2512e0b449e68fbac49b5d4edaca/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:14:01.532593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.532942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.533226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.560837 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] MFA Rules not processed for user `1cab2512e0b449e68fbac49b5d4edaca`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:14:01.562003 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:01.623449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1322/2629] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:14:01.628029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.689429 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921d5d2-782e-482b-9ac6-10ea8238e814 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.693990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.694644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.694952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.695238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.695929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.697867 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.722891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1308/2630] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:14:01.726928 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.736852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e354-c9b3-4ce0-9f16-218200e3d8d5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.792190 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.792855 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.793135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.793407 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.794089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.796097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.815489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1323/2631] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:14:01.819683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.828982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ed368-a4a5-40c6-b6f7-893ff9703b49 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.833329 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.834000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.834281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.834554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.835356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.836940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.847489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1309/2632] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:14:01.851930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.860916 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88208968-c536-49ba-92ff-96c5cc533a63 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.865797 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598df2-38a7-4da7-bffe-5455d07410e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.866442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598df2-38a7-4da7-bffe-5455d07410e8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.866757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598df2-38a7-4da7-bffe-5455d07410e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.867062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598df2-38a7-4da7-bffe-5455d07410e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.867777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de598df2-38a7-4da7-bffe-5455d07410e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.869359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de598df2-38a7-4da7-bffe-5455d07410e8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.879074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1324/2633] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:14:01.882828 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:01.892732 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6d806-3229-449b-9b1c-1ff7b137b1ed admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:01.897059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:01.897852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.898129 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.898399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] PATH_INFO: `/v3/projects/963e2e4faeb84421a0bdda858ad3a0f7/users/2adbce18dfcc4cb297c72282d7c5949f/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:01.912539 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963e2e4faeb84421a0bdda858ad3a0f7, user_id=2adbce18dfcc4cb297c72282d7c5949f, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:01.915291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:01.928713 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1310/2634] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:14:01 2021] PUT /identity/v3/projects/963e2e4faeb84421a0bdda858ad3a0f7/users/2adbce18dfcc4cb297c72282d7c5949f/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:14:01.979781 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:01.980074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:01.980360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.005860 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] MFA Rules not processed for user `2adbce18dfcc4cb297c72282d7c5949f`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:14:02.007057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:02.067222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1325/2635] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:14:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:14:02.071707 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.129441 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241ba85-a757-4295-a56a-6ddb93b77d74 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.133731 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.134366 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.134647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.134931 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.135623 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.137519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.161190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1311/2636] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:14:02 2021] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:14:02.165220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.175049 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a7301-c5ba-44c5-b4a9-f5a1fac48835 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.228910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.229590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.229875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.230154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.230831 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.232768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.255818 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1326/2637] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:14:02 2021] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:14:02.257071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.266406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df85f2-35d6-4d76-9ad0-c5be5418f6ff admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.270605 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.271815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.272093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.272363 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.273098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.274690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.285676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1312/2638] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:14:02.290601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.300703 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87730c20-b8ff-42a5-befb-c82b3671b8d3 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.305195 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.306062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.306339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.306611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] PATH_INFO: `/v3/projects/b16f13d48e794482a98c20e7abfe30f9/users/7c530f810e614959a42546d633331f81/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.320965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16f13d48e794482a98c20e7abfe30f9, user_id=7c530f810e614959a42546d633331f81, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.323659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.336349 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1327/2639] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:14:02 2021] PUT /identity/v3/projects/b16f13d48e794482a98c20e7abfe30f9/users/7c530f810e614959a42546d633331f81/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:14:02.340472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.350121 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22299953-30fe-4c62-a78e-fe9c9fc62060 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.401004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9186-5d73-45d2-8981-e173cabbf383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.401646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9186-5d73-45d2-8981-e173cabbf383 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.401923 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9186-5d73-45d2-8981-e173cabbf383 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.402195 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9186-5d73-45d2-8981-e173cabbf383 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.402898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9186-5d73-45d2-8981-e173cabbf383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.404508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9186-5d73-45d2-8981-e173cabbf383 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.414489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1313/2640] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:14:02.418453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.427971 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2348-bedb-4a31-b63a-fa3fbdc10c7d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.432300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.433168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.433451 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.433730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] PATH_INFO: `/v3/projects/b16f13d48e794482a98c20e7abfe30f9/users/7c530f810e614959a42546d633331f81/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.435583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16f13d48e794482a98c20e7abfe30f9, user_id=7c530f810e614959a42546d633331f81, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.438211 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.448558 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1328/2641] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:14:02 2021] PUT /identity/v3/projects/b16f13d48e794482a98c20e7abfe30f9/users/7c530f810e614959a42546d633331f81/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:14:02.458344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.459267 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.459575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.484051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] MFA Rules not processed for user `7c530f810e614959a42546d633331f81`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:14:02.485197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:02.548810 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1314/2642] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:14:02 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:14:02.558541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:02.560225 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:02.614330 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33f80a-6112-483e-be72-8b50ec80cfb4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:02.617833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:02.618467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:02.618752 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:02.619057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:02.672719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:02.674135 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:02.682472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1329/2643] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:14:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:14:31.914929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:14:31.916281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:32.028925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5c1f-3dd9-45c5-948f-6ba8c2bab884 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:14:32.033640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:14:32.034277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:14:32.034558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:14:32.034833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:14:32.037283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:14:32.047608 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:14:32.049180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:14:32.058392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1315/2644] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:14:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:17:05.436754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:17:05.438151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:17:05.458501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4019-128b-4a9d-bc81-cd55f9aaa386 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:17:05.462549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:17:05.463220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:17:05.463504 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:17:05.463774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:17:05.465427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:17:05.532457 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:17:05.533824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:17:05.542309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1330/2645] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:17:05 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:17:05.948534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:17:05.967558 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027796-8a9b-426c-8381-917adc8ffd5a service placement] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:17:05.970992 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:17:05.971625 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:17:05.971911 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:17:05.972189 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:17:05.973868 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:17:06.028807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:17:06.030247 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:17:06.038545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1316/2646] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:17:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:17:58.461833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:17:58.469836 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f202e42-1aca-4222-ace2-59078fc4449c service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:17:58.473311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:17:58.473982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:17:58.474269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:17:58.474540 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:17:58.533251 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:17:58.534690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:17:58.543237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1331/2647] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:17:58 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:17:59.028638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:17:59.036691 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8c180-443d-4190-914a-d2eb644d6597 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:17:59.040382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:17:59.041016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:17:59.041300 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:17:59.041584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:17:59.049949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:17:59.051427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:17:59.060641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1317/2648] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:17:59 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:17:59.294060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:17:59.295443 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:17:59.350653 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c252d-1804-4196-a232-d7f79b7692a3 service cinder] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:17:59.354240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:17:59.354923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:17:59.355222 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:17:59.355496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:17:59.357139 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:17:59.417840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:17:59.419553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:17:59.429322 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1332/2649] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:17:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:00.646381 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:00.647993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:00.659384 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7656315-4d54-465e-a3a2-15acea119e85 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:00.663444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:00.664174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:00.664458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:00.664736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:00.666413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:00.677283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:00.679435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:00.688280 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1318/2650] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:01.276997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:01.278735 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:01.290966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34674598-384b-48bf-9fb2-b92f31dca028 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:01.296945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:01.298088 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:01.298474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:01.298871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] PATH_INFO: `/v3/users/5de6ce3baedc402b982fa28cf4412889` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:01.300210 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de6ce3baedc402b982fa28cf4412889)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:01.302477 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:01.358244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de6ce3baedc402b982fa28cf4412889'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.365032 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de6ce3baedc402b982fa28cf4412889'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.366306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de6ce3baedc402b982fa28cf4412889'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.378310 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de6ce3baedc402b982fa28cf4412889'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.387311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de6ce3baedc402b982fa28cf4412889'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.394822 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1333/2651] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:01 2021] DELETE /identity/v3/users/5de6ce3baedc402b982fa28cf4412889 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:01.585568 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:01.602142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc358d-9afd-4ecd-bebd-c1e378e48f09 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:01.673330 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:01.674597 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:01.675087 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:01.675676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] PATH_INFO: `/v3/projects/1b1c50957d614bf3b196a9502dbb0872` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:01.677046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1c50957d614bf3b196a9502dbb0872)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:01.679527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:01.747433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1c50957d614bf3b196a9502dbb0872', 'request_id': 'req-390f052a-3cf2-4cec-be2b-919c1e2f1949'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.754058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1c50957d614bf3b196a9502dbb0872', 'request_id': 'req-390f052a-3cf2-4cec-be2b-919c1e2f1949'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.762870 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1c50957d614bf3b196a9502dbb0872', 'request_id': 'req-390f052a-3cf2-4cec-be2b-919c1e2f1949'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.774368 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] The token cache is being invalidate because project 1b1c50957d614bf3b196a9502dbb0872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:01.774653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.775514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:01.777048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1319/2652] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:01 2021] DELETE /identity/v3/projects/1b1c50957d614bf3b196a9502dbb0872 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:03.070777 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.072370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.075041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.076877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.087400 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa242d8-dfc5-4ad0-b2aa-0ae70982a617 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.141113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.141334 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f052a-3cf2-4cec-be2b-919c1e2f1949 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.141981 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.142266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.142541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] PATH_INFO: `/v3/users/abce52cb36c6462c98204d6e0846857a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.143706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abce52cb36c6462c98204d6e0846857a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.145500 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.145639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.146361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.146645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.147013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] PATH_INFO: `/v3/users/1cab2512e0b449e68fbac49b5d4edaca` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.149272 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cab2512e0b449e68fbac49b5d4edaca)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.151199 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.193127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abce52cb36c6462c98204d6e0846857a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.197214 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cab2512e0b449e68fbac49b5d4edaca'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.197879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cab2512e0b449e68fbac49b5d4edaca'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.200535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abce52cb36c6462c98204d6e0846857a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.201257 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abce52cb36c6462c98204d6e0846857a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.204659 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cab2512e0b449e68fbac49b5d4edaca'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.212147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cab2512e0b449e68fbac49b5d4edaca'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.212842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cab2512e0b449e68fbac49b5d4edaca'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.214315 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abce52cb36c6462c98204d6e0846857a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.221097 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-40af3bd4-a46a-4cb7-8536-4e676748a70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abce52cb36c6462c98204d6e0846857a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.227647 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1334/2653] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:03 2021] DELETE /identity/v3/users/abce52cb36c6462c98204d6e0846857a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:03.231246 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1320/2654] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:03 2021] DELETE /identity/v3/users/1cab2512e0b449e68fbac49b5d4edaca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:03.235799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.236096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.236373 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.259530 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:03.260852 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.318389 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1335/2655] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:03.328277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.329736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.385769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b6fa9-69bb-462b-87bf-bfcf757757b5 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.389584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a64b-ac9f-4548-b504-e9dfe6528fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.390273 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a64b-ac9f-4548-b504-e9dfe6528fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.390552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a64b-ac9f-4548-b504-e9dfe6528fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.390827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a64b-ac9f-4548-b504-e9dfe6528fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.400232 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a64b-ac9f-4548-b504-e9dfe6528fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.401696 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a64b-ac9f-4548-b504-e9dfe6528fa1 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.404528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.405833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.412652 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1321/2656] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:03.422305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7559-9db6-4e84-b684-d6ef54c2c477 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.426813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.427705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.428019 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.429281 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] PATH_INFO: `/v3/projects/c9ad3e7e277b44e38e556ff018a3e139` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.430616 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ad3e7e277b44e38e556ff018a3e139)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.432544 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.478812 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ad3e7e277b44e38e556ff018a3e139', 'request_id': 'req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.485152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ad3e7e277b44e38e556ff018a3e139', 'request_id': 'req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.492750 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ad3e7e277b44e38e556ff018a3e139', 'request_id': 'req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.504067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] The token cache is being invalidate because project c9ad3e7e277b44e38e556ff018a3e139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:03.504353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.505004 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-2aeff7ab-43eb-43c7-ad5d-070b0b6a7cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.506712 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1336/2657] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:03 2021] DELETE /identity/v3/projects/c9ad3e7e277b44e38e556ff018a3e139 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:03.513894 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.514186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.514467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.532489 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:03.534205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.597902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1322/2658] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:03.605850 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.606472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.606472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.624507 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:03.625665 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.633502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1337/2659] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:03.637583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.646411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02280b0-96b1-4c30-ae6f-29416fe33017 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.651196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.651852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.652142 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.652445 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.653164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:03.653474 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.655105 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.668458 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1323/2660] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:03.672700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.683297 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ddcee-1bca-4d0a-9be7-8f352c16dc85 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.687879 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.688534 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.688817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.689094 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.689790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.691926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.707927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.710210 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.727002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1338/2661] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:03 2021] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:03.731110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.732475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8a209-9520-4274-9985-7052fa02af28 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.791289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.792143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.792421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.792693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] PATH_INFO: `/v3/projects/da005a30f4b34059be6788903cc5e373` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.793825 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da005a30f4b34059be6788903cc5e373)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.795744 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.797447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fad75b-e240-4e2a-bd65-6021429a6df0 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.802435 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.803420 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.803690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.803943 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.804640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.806583 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.830123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1339/2662] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:03 2021] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:03.831714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.841011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7621b-a120-4a05-9a4d-c262fe4482c5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.845607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da005a30f4b34059be6788903cc5e373', 'request_id': 'req-bcb8e568-d42b-417f-96cb-ce5957e69b94'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.851188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da005a30f4b34059be6788903cc5e373', 'request_id': 'req-bcb8e568-d42b-417f-96cb-ce5957e69b94'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.858382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da005a30f4b34059be6788903cc5e373', 'request_id': 'req-bcb8e568-d42b-417f-96cb-ce5957e69b94'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.869315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] The token cache is being invalidate because project da005a30f4b34059be6788903cc5e373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:03.869598 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.870346 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.874690 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1324/2663] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:03 2021] DELETE /identity/v3/projects/da005a30f4b34059be6788903cc5e373 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:03.875667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.876969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.895319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.896016 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.896302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.896584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.898111 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.899768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.909601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1340/2664] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:03 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:03.913552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.915172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:03.926388 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d658-09a8-420b-a0f7-d4d514f89d18 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.931479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.932237 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.932523 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.932799 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.933545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.935174 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.937838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e568-d42b-417f-96cb-ce5957e69b94 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.942276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.943166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.943447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.943722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] PATH_INFO: `/v3/users/2adbce18dfcc4cb297c72282d7c5949f` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.945393 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adbce18dfcc4cb297c72282d7c5949f)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.945624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1341/2665] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:03.948976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.949843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:03.959247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4014-0a34-4afa-a259-814883859bdf admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:03.964357 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3d43c-d6e1-4704-b073-4ded497be8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:03.965232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3d43c-d6e1-4704-b073-4ded497be8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:03.965518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3d43c-d6e1-4704-b073-4ded497be8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:03.965800 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3d43c-d6e1-4704-b073-4ded497be8d3 admin admin] PATH_INFO: `/v3/projects/1c40fd716bbe4e139ad4a98d503e6e65/users/31a65d7713d647ba944db497a416209d/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:03.980450 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3d43c-d6e1-4704-b073-4ded497be8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c40fd716bbe4e139ad4a98d503e6e65, user_id=31a65d7713d647ba944db497a416209d, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:03.983244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3d43c-d6e1-4704-b073-4ded497be8d3 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:03.994153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adbce18dfcc4cb297c72282d7c5949f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.994819 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adbce18dfcc4cb297c72282d7c5949f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:03.996754 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1342/2666] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:03 2021] PUT /identity/v3/projects/1c40fd716bbe4e139ad4a98d503e6e65/users/31a65d7713d647ba944db497a416209d/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:04.001673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adbce18dfcc4cb297c72282d7c5949f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.008075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:04.008403 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:04.008686 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:04.009416 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adbce18dfcc4cb297c72282d7c5949f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.010046 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adbce18dfcc4cb297c72282d7c5949f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.026419 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1325/2667] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:03 2021] DELETE /identity/v3/users/2adbce18dfcc4cb297c72282d7c5949f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:04.034808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] MFA Rules not processed for user `31a65d7713d647ba944db497a416209d`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:04.036254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:04.102697 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1343/2668] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:04 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:04.112893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:04.114378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:04.169746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40a62-878a-42ba-b7d5-3b1c6cda1c0e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:04.173191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:04.173839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:04.174120 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:04.174394 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:04.183360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:04.184842 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:04.204906 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1326/2669] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:04 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:04.319253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:04.320854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:04.399324 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0977f-3801-46e5-89fa-76ded0b2fe30 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:04.403769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:04.404762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:04.405231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:04.405546 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] PATH_INFO: `/v3/projects/963e2e4faeb84421a0bdda858ad3a0f7` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:04.406770 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=963e2e4faeb84421a0bdda858ad3a0f7)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:04.408931 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:04.456533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963e2e4faeb84421a0bdda858ad3a0f7', 'request_id': 'req-be5c810b-e9da-44cb-aad2-4db17fe9c449'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.462650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963e2e4faeb84421a0bdda858ad3a0f7', 'request_id': 'req-be5c810b-e9da-44cb-aad2-4db17fe9c449'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.470690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963e2e4faeb84421a0bdda858ad3a0f7', 'request_id': 'req-be5c810b-e9da-44cb-aad2-4db17fe9c449'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.483030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] The token cache is being invalidate because project 963e2e4faeb84421a0bdda858ad3a0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:04.483358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.484114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.485700 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1344/2670] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:04 2021] DELETE /identity/v3/projects/963e2e4faeb84421a0bdda858ad3a0f7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:04.489621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:04.501504 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23eb5-40a3-462d-87f9-a215138e7bbe service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:04.556979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:04.557852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:04.558139 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:04.558413 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] PATH_INFO: `/v3/users/7c530f810e614959a42546d633331f81` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:04.559563 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c530f810e614959a42546d633331f81)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:04.561490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:04.606371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c530f810e614959a42546d633331f81'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.607045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c530f810e614959a42546d633331f81'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.613514 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c530f810e614959a42546d633331f81'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.620750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c530f810e614959a42546d633331f81'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.621375 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-2b134f40-8e43-47e8-b355-42eded4473ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c530f810e614959a42546d633331f81'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:04.638019 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1327/2671] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:04 2021] DELETE /identity/v3/users/7c530f810e614959a42546d633331f81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:04.908370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:04.909869 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:04.923487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c810b-e9da-44cb-aad2-4db17fe9c449 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:04.978553 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:04.979502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:04.979786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:04.980063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] PATH_INFO: `/v3/projects/b16f13d48e794482a98c20e7abfe30f9` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:04.981173 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16f13d48e794482a98c20e7abfe30f9)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:04.983103 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.027253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16f13d48e794482a98c20e7abfe30f9', 'request_id': 'req-e15ad97e-100a-4ca2-a653-2fe387cc0eef'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:05.032253 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16f13d48e794482a98c20e7abfe30f9', 'request_id': 'req-e15ad97e-100a-4ca2-a653-2fe387cc0eef'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:05.039154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16f13d48e794482a98c20e7abfe30f9', 'request_id': 'req-e15ad97e-100a-4ca2-a653-2fe387cc0eef'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:05.049768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] The token cache is being invalidate because project b16f13d48e794482a98c20e7abfe30f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:05.050047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:05.050655 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-e15ad97e-100a-4ca2-a653-2fe387cc0eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:05.052182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1345/2672] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:04 2021] DELETE /identity/v3/projects/b16f13d48e794482a98c20e7abfe30f9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:05.058491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.058778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.059167 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.076383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:05.077540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:05.132537 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1328/2673] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:05.140422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.140798 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.140974 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.158110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:05.159287 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:05.167199 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1346/2674] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:05.171283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.180647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e29dd-eeb5-4ea7-aa9f-5c8f26441f3a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.185074 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.185729 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.186014 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.186292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.187068 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:05.187385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.188994 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.200343 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1329/2675] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:05.204474 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.212984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe597-bb7a-4ca1-a0b1-82daa9b66349 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.217337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.217975 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.218261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.218537 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.219262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.221145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.246680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1347/2676] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:05 2021] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:05.250675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.259990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21e742-b3c4-4139-b268-c049713be795 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.312011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.312701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.313052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.313271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.313965 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.315933 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.334805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1330/2677] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:05 2021] POST /identity/v3/users => generated 285 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:05.339188 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.348501 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1a1a-b2ba-4703-8ff3-db638e322d94 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.353562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.354230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.354495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.354771 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.355517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.357114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.367746 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1348/2678] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:05.371752 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.380927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0087-8aff-4326-b96e-62b3675f31bf admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.385406 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb378f-1c68-4287-b90e-8036bc40eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.386051 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb378f-1c68-4287-b90e-8036bc40eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.386335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb378f-1c68-4287-b90e-8036bc40eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.386615 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb378f-1c68-4287-b90e-8036bc40eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.387378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb378f-1c68-4287-b90e-8036bc40eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.388970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb378f-1c68-4287-b90e-8036bc40eb8a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.398420 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1331/2679] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:05 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:05.402191 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.411129 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae9632-ddfc-4a33-bc3d-71dc5f871adc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.416152 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.417007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.417288 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.417563 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] PATH_INFO: `/v3/projects/aacd8603c0754173a6b1a1c7e9d5ef96/users/743947c0778e4afe9b2b8795caa9a3a4/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.431769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacd8603c0754173a6b1a1c7e9d5ef96, user_id=743947c0778e4afe9b2b8795caa9a3a4, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.434393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.446296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1349/2680] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:05 2021] PUT /identity/v3/projects/aacd8603c0754173a6b1a1c7e9d5ef96/users/743947c0778e4afe9b2b8795caa9a3a4/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:05.457012 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.457301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.457576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.482621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] MFA Rules not processed for user `743947c0778e4afe9b2b8795caa9a3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:05.483805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:05.545877 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1332/2681] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:05 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:05.559107 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.560730 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:05.576658 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:05.578039 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:05.632536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66f85b-71e7-4ca2-838b-55b250ed7d1f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.636008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.636641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.636884 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed70892-f86a-4c2d-b4d4-f4af26897ea7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:05.637013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.637175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.638862 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:05.640455 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2227b93e13c4a418b506b2a2c011c76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:05.641154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:05.641446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:05.641727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:05.650380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.651853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.660375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1350/2682] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:05 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:05.728198 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:05.729654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:05.749325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1333/2683] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:07.149196 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:07.150561 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:07.161497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b1f9-dcf5-469e-bebe-e2cfa60a15cb service glance] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:07.164932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:07.165565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:07.165842 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:07.166113 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:07.167765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:07.183226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:07.184663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9746cc4-9306-4764-a68e-ed62a8aec329 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:07.195688 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1351/2684] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:12.755620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:12.757052 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:12.818795 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd6bd-a8e6-40f6-b3d6-155f8b446093 service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:12.823701 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:12.824577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:12.824864 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:12.825143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] PATH_INFO: `/v3/users/31a65d7713d647ba944db497a416209d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:12.826285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a65d7713d647ba944db497a416209d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:12.828260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:12.875268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a65d7713d647ba944db497a416209d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:12.875925 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a65d7713d647ba944db497a416209d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:12.882593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a65d7713d647ba944db497a416209d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:12.889021 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a65d7713d647ba944db497a416209d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:12.889741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a65d7713d647ba944db497a416209d'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:12.906340 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1334/2685] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:12 2021] DELETE /identity/v3/users/31a65d7713d647ba944db497a416209d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:12.911023 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:12.911493 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:12.911593 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:12.929104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:12.930319 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:12.986208 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1352/2686] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:12.996207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:12.997716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:13.054509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0135e-af6c-4f65-8ea6-8c8ee1b468b6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.058197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734041b-5338-4b16-a7dd-f92e9a7e384e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.058850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734041b-5338-4b16-a7dd-f92e9a7e384e service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.059164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734041b-5338-4b16-a7dd-f92e9a7e384e service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.059442 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734041b-5338-4b16-a7dd-f92e9a7e384e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.068298 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734041b-5338-4b16-a7dd-f92e9a7e384e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.069747 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734041b-5338-4b16-a7dd-f92e9a7e384e service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.079149 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1335/2687] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:13.362705 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.364142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:13.376760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abc01c-3139-4d16-9a4a-3f9f7ff0fad2 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.381723 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.382618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.382901 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.383207 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] PATH_INFO: `/v3/projects/1c40fd716bbe4e139ad4a98d503e6e65` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.384479 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c40fd716bbe4e139ad4a98d503e6e65)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.386622 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.435740 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c40fd716bbe4e139ad4a98d503e6e65', 'request_id': 'req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:13.440923 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c40fd716bbe4e139ad4a98d503e6e65', 'request_id': 'req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:13.448871 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c40fd716bbe4e139ad4a98d503e6e65', 'request_id': 'req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:13.460075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] The token cache is being invalidate because project 1c40fd716bbe4e139ad4a98d503e6e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:13.460359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:13.460990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c1eafd77-241b-4d1c-8c77-6cf7ef25c92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:13.463181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1353/2688] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:13 2021] DELETE /identity/v3/projects/1c40fd716bbe4e139ad4a98d503e6e65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:13.469125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.469511 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.469860 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.487769 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:13.488940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:13.546920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1336/2689] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:13.554694 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.555012 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.555296 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.574130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:13.575380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:13.583017 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1354/2690] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:13.587224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.596879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a182de-8626-4b75-8cc9-97405539864c None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.601251 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.601960 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.602242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.602516 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.603973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:13.604276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.605876 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.617477 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1337/2691] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:13.622226 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.630714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef424a-66dd-4f00-b1d7-19d816bff50b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.635469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.636118 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.636408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.636685 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.637374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.639336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.668227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1355/2692] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:13 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:13.669264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.678635 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771a2d-f321-4adb-a11b-0c2164dbe419 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.735604 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.736281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.736552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.736835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.737523 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.739469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.760454 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1338/2693] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:13 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:13.764327 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.773851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b1fde-f3a6-450c-8953-90fe6d0aab4f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.778959 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.779630 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.779917 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.780197 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.780918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.782535 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.793586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1356/2694] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:13.797699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.807224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8898262-3061-4cb3-8362-5453b5145521 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.811536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74420d-0ed7-4933-a513-ae202ed82301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.812197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74420d-0ed7-4933-a513-ae202ed82301 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.812481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74420d-0ed7-4933-a513-ae202ed82301 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.812757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74420d-0ed7-4933-a513-ae202ed82301 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.813472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74420d-0ed7-4933-a513-ae202ed82301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.815097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74420d-0ed7-4933-a513-ae202ed82301 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.825066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1339/2695] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:13.829204 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:13.840056 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf106ed-71d8-4509-a2ac-f8c7d2699344 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:13.844465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:13.845347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.845640 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.845915 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] PATH_INFO: `/v3/projects/1f49d0b8dc3140228eec79e4d8788415/users/3ba84a6f59234cdaaa5f23063cc1366f/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.862145 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f49d0b8dc3140228eec79e4d8788415, user_id=3ba84a6f59234cdaaa5f23063cc1366f, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:13.864813 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:13.877615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1357/2696] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:13 2021] PUT /identity/v3/projects/1f49d0b8dc3140228eec79e4d8788415/users/3ba84a6f59234cdaaa5f23063cc1366f/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:13.889100 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:13.889462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:13.889746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:13.916971 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] MFA Rules not processed for user `3ba84a6f59234cdaaa5f23063cc1366f`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:13.918141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:13.983431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1340/2697] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:13 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:13.988067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.049883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b34ca2-235e-448d-9bbf-1f6c23c36b5f admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.054338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.055022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.055308 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.055585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.057423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.059359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.084375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1358/2698] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:13 2021] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:14.088580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.099444 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2eca8-b940-4f8b-9bdc-51859c536698 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.154543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.155245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.155532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.155808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.156493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.158409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.177008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1341/2699] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:14 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:14.181657 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.192069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595a208-e1ae-4763-811e-052ccbfcc2df admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.197250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.197945 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.198241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.198522 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.199290 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.200932 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.211984 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1359/2700] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:14.216735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.225853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be4dc9-0d92-433c-a5be-0a208e951640 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.230754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.231642 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.231920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.232203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] PATH_INFO: `/v3/projects/003b9a14a28b4aa5899887bb6a86a9f1/users/394cd81f904744cc97e9d828010c3571/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.249141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003b9a14a28b4aa5899887bb6a86a9f1, user_id=394cd81f904744cc97e9d828010c3571, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.251898 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.265443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1342/2701] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:14 2021] PUT /identity/v3/projects/003b9a14a28b4aa5899887bb6a86a9f1/users/394cd81f904744cc97e9d828010c3571/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:14.269385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.278888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc80b9-833a-48e1-ade0-affad8df46f1 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.333900 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3328b-4a34-4e50-bab5-aadf01a30e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.334552 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3328b-4a34-4e50-bab5-aadf01a30e0a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.334832 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3328b-4a34-4e50-bab5-aadf01a30e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.335314 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3328b-4a34-4e50-bab5-aadf01a30e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.336025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3328b-4a34-4e50-bab5-aadf01a30e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.337689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3328b-4a34-4e50-bab5-aadf01a30e0a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.347079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1360/2702] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:14.351392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.362291 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e8c2-4274-4aca-ab1d-bd5b76640f10 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.366736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.367678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.368032 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.369033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] PATH_INFO: `/v3/projects/003b9a14a28b4aa5899887bb6a86a9f1/users/394cd81f904744cc97e9d828010c3571/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.370869 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003b9a14a28b4aa5899887bb6a86a9f1, user_id=394cd81f904744cc97e9d828010c3571, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.373535 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.383547 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1343/2703] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:14 2021] PUT /identity/v3/projects/003b9a14a28b4aa5899887bb6a86a9f1/users/394cd81f904744cc97e9d828010c3571/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:14.393830 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.394200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.394487 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.421106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] MFA Rules not processed for user `394cd81f904744cc97e9d828010c3571`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:14.422284 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:14.488348 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1361/2704] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:14 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:14.498590 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.500337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:14.559571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be028b3-034d-46bc-9a09-eeab04827b88 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.563253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcbcdb-e731-4ab1-ac82-03bd34f3b713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.563908 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcbcdb-e731-4ab1-ac82-03bd34f3b713 service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.564196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcbcdb-e731-4ab1-ac82-03bd34f3b713 service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.564470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcbcdb-e731-4ab1-ac82-03bd34f3b713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.574221 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcbcdb-e731-4ab1-ac82-03bd34f3b713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.575703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcbcdb-e731-4ab1-ac82-03bd34f3b713 service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.584671 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1344/2705] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:14 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:14.841838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:14.900792 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816cff6-1340-4a89-b288-cf27d0334edb None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:14.905078 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:14.906030 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.906316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.906592 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] PATH_INFO: `/v3/users/3ba84a6f59234cdaaa5f23063cc1366f` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:14.907940 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba84a6f59234cdaaa5f23063cc1366f)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:14.910304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:14.954182 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba84a6f59234cdaaa5f23063cc1366f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:14.961488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba84a6f59234cdaaa5f23063cc1366f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:14.962833 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba84a6f59234cdaaa5f23063cc1366f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:14.974646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba84a6f59234cdaaa5f23063cc1366f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:14.982026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba84a6f59234cdaaa5f23063cc1366f'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:14.987773 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1362/2706] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:14 2021] DELETE /identity/v3/users/3ba84a6f59234cdaaa5f23063cc1366f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:14.992355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:14.992838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:14.992993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:15.010816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:15.012017 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:15.067260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1345/2707] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:15.077417 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:15.078743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:15.132774 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711115b8-a88b-444d-83ed-9417d7be6f64 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:15.136718 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:15.137356 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:15.137635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:15.137906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:15.146369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:15.147824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:15.157013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1363/2708] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:15.434999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:15.436392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:15.447961 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29c67-8e6a-4d3c-80bb-4b8b141c1f51 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:15.452582 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:15.453457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:15.453741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:15.454016 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] PATH_INFO: `/v3/projects/1f49d0b8dc3140228eec79e4d8788415` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:15.455197 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f49d0b8dc3140228eec79e4d8788415)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:15.457382 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:15.502564 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f49d0b8dc3140228eec79e4d8788415', 'request_id': 'req-e5f251d5-14ff-48c7-96f7-77601adc5b7c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.508607 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f49d0b8dc3140228eec79e4d8788415', 'request_id': 'req-e5f251d5-14ff-48c7-96f7-77601adc5b7c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.516297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f49d0b8dc3140228eec79e4d8788415', 'request_id': 'req-e5f251d5-14ff-48c7-96f7-77601adc5b7c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.528285 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] The token cache is being invalidate because project 1f49d0b8dc3140228eec79e4d8788415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:15.528571 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.529181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.530721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1346/2709] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:15 2021] DELETE /identity/v3/projects/1f49d0b8dc3140228eec79e4d8788415 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:15.534840 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:15.544682 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286a414-d71c-4fe2-9e1f-9efa013366b8 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:15.600364 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:15.601230 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:15.601512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:15.601787 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] PATH_INFO: `/v3/users/394cd81f904744cc97e9d828010c3571` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:15.603168 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=394cd81f904744cc97e9d828010c3571)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:15.605007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:15.649002 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394cd81f904744cc97e9d828010c3571'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.656292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394cd81f904744cc97e9d828010c3571'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.656949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394cd81f904744cc97e9d828010c3571'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.669383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394cd81f904744cc97e9d828010c3571'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.675693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-ae669612-374a-4f35-bf78-81c6b72f5a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394cd81f904744cc97e9d828010c3571'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:15.681708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1364/2710] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:15 2021] DELETE /identity/v3/users/394cd81f904744cc97e9d828010c3571 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:15.971674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:15.973661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:15.986370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f251d5-14ff-48c7-96f7-77601adc5b7c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.044781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.045645 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.045929 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.046207 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] PATH_INFO: `/v3/projects/003b9a14a28b4aa5899887bb6a86a9f1` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.047372 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] RBAC: Authorizing `identity:delete_project(project_id=003b9a14a28b4aa5899887bb6a86a9f1)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.049292 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.094811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003b9a14a28b4aa5899887bb6a86a9f1', 'request_id': 'req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:16.099967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003b9a14a28b4aa5899887bb6a86a9f1', 'request_id': 'req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:16.106448 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003b9a14a28b4aa5899887bb6a86a9f1', 'request_id': 'req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:16.117361 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] The token cache is being invalidate because project 003b9a14a28b4aa5899887bb6a86a9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:16.117644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:16.118833 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-d8a593d1-14d1-47ce-a22d-fbb4eca5701c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:16.120383 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1347/2711] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:15 2021] DELETE /identity/v3/projects/003b9a14a28b4aa5899887bb6a86a9f1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:16.126034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.126506 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.126738 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.144816 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:16.146063 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:16.204601 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1365/2712] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:16.213228 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.213519 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.213812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.231518 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:16.232603 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:16.240501 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1348/2713] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:16.246835 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.255795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745ad8-58bd-4155-8ce5-e8198f3cc5cc None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.260706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.261352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.261633 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.261906 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.262615 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:16.262949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.264550 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.276249 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1366/2714] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:16.280575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.289215 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcaa20-c621-4e43-a35e-e32047722d4a None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.294397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.295111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.295403 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.295683 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.296396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.298326 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.325171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1349/2715] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:16.329372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.339289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45646d8-da6d-4bef-a32a-cd36b711281c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.394447 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.395372 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.395666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.395947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.396649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.398590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.418434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1367/2716] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:16.422521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.432392 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22f1b-73b3-41c5-990f-d1950295991b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.436763 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.437411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.437697 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.437974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.438688 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.440336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.451817 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1350/2717] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:16.455790 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.465370 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de764-79d2-4b74-98d7-7612497f8253 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.469643 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c5200-e2d6-41dc-91bc-b64e08011c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.470286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5200-e2d6-41dc-91bc-b64e08011c7a admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.470562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5200-e2d6-41dc-91bc-b64e08011c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.470834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5200-e2d6-41dc-91bc-b64e08011c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.471600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c5200-e2d6-41dc-91bc-b64e08011c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.473215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c5200-e2d6-41dc-91bc-b64e08011c7a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.483434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1368/2718] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:16.487412 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.496940 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f523f-0051-40d3-979f-eccd27960b1d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.501721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.502668 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.503089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.503371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] PATH_INFO: `/v3/projects/9515c6bbbc1b438d89b1cfaa0650833c/users/b42384091deb49b8a8c1aa30031ab8fa/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.518784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9515c6bbbc1b438d89b1cfaa0650833c, user_id=b42384091deb49b8a8c1aa30031ab8fa, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.521478 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.534033 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1351/2719] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:16 2021] PUT /identity/v3/projects/9515c6bbbc1b438d89b1cfaa0650833c/users/b42384091deb49b8a8c1aa30031ab8fa/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:16.545768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.546062 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.546342 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.574215 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] MFA Rules not processed for user `b42384091deb49b8a8c1aa30031ab8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:16.575431 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:16.638532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1369/2720] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:16.643356 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.703428 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331badb-4277-4ce9-ae8a-3d5ef257fa93 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.708325 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.708976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.709263 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.709538 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.710243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.712814 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.737687 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1352/2721] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:16.741759 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.752178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28828-92d2-43f0-9ce1-a7eb0605751b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.806240 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.806980 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.807272 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.807545 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.808243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.810194 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.829998 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1370/2722] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:16 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:16.834206 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.844486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7200-f83f-43af-8e64-f444833e0888 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.848761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.849402 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.849680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.849952 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.850654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.852399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.863798 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1353/2723] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:16.867941 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.877948 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7804b-6c66-454d-8829-deb3fe77b0bc admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.882241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.883141 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.883428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.883808 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] PATH_INFO: `/v3/projects/d8a6be59ea5645e3a89306684c2e776a/users/2f1e905de1fa4cceb487d9b1e175cbd9/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.898269 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a6be59ea5645e3a89306684c2e776a, user_id=2f1e905de1fa4cceb487d9b1e175cbd9, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.901586 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.916286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1371/2724] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:16 2021] PUT /identity/v3/projects/d8a6be59ea5645e3a89306684c2e776a/users/2f1e905de1fa4cceb487d9b1e175cbd9/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:16.920289 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:16.929726 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0cc5c-084e-4f1c-be8f-fff29fe7df0e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:16.982310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035093e-6e1d-41db-be51-4012b2ecd109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:16.983002 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035093e-6e1d-41db-be51-4012b2ecd109 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:16.983282 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035093e-6e1d-41db-be51-4012b2ecd109 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:16.983555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035093e-6e1d-41db-be51-4012b2ecd109 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:16.984275 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035093e-6e1d-41db-be51-4012b2ecd109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:16.985866 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035093e-6e1d-41db-be51-4012b2ecd109 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:16.996253 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1354/2725] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:17.000018 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:17.010573 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8c8b-bbe7-4a0a-8bc2-4588d8f4264e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:17.015026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:17.015912 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.016192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.016465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] PATH_INFO: `/v3/projects/d8a6be59ea5645e3a89306684c2e776a/users/2f1e905de1fa4cceb487d9b1e175cbd9/roles/620fb448cda4468da4c7442522368bea` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.018311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a6be59ea5645e3a89306684c2e776a, user_id=2f1e905de1fa4cceb487d9b1e175cbd9, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:17.020988 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:17.032957 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1372/2726] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:16 2021] PUT /identity/v3/projects/d8a6be59ea5645e3a89306684c2e776a/users/2f1e905de1fa4cceb487d9b1e175cbd9/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:17.043470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.043756 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.044054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.070388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] MFA Rules not processed for user `2f1e905de1fa4cceb487d9b1e175cbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:17.072190 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:17.137903 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1355/2727] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:17 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:17.148158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:17.150428 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:17.204520 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22550a1-43df-41c0-8818-62fa8f997bb4 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:17.208220 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336a543-13a2-4640-9c73-0d6197b217a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:17.208853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a543-13a2-4640-9c73-0d6197b217a2 service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.209132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a543-13a2-4640-9c73-0d6197b217a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.209446 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336a543-13a2-4640-9c73-0d6197b217a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.218710 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336a543-13a2-4640-9c73-0d6197b217a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:17.220565 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336a543-13a2-4640-9c73-0d6197b217a2 service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:17.229726 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1373/2728] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:17 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:17.365555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:17.424606 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d305-2e83-4609-a74f-f94a554f30ab None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:17.428838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:17.429684 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.429967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.430243 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] PATH_INFO: `/v3/users/b42384091deb49b8a8c1aa30031ab8fa` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.432043 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42384091deb49b8a8c1aa30031ab8fa)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:17.433955 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:17.477238 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42384091deb49b8a8c1aa30031ab8fa'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:17.478481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42384091deb49b8a8c1aa30031ab8fa'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:17.485045 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42384091deb49b8a8c1aa30031ab8fa'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:17.491852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42384091deb49b8a8c1aa30031ab8fa'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:17.492609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42384091deb49b8a8c1aa30031ab8fa'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:17.509435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1356/2729] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:17 2021] DELETE /identity/v3/users/b42384091deb49b8a8c1aa30031ab8fa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:17.514064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.514361 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.514658 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.532588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:17.533749 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:17.589964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1374/2730] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:17.599585 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:17.601001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:17.656230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d1967-70d8-4cf9-9fbd-dfc2af667ec2 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:17.659893 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:17.660566 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.660874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.661152 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.671851 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:17.673337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:17.682717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1357/2731] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:17.954302 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:17.955755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:17.966935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98479b05-7dee-4319-8fbb-fe32ccac3f1e None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:17.971292 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:17.972156 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:17.972441 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:17.972720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] PATH_INFO: `/v3/projects/9515c6bbbc1b438d89b1cfaa0650833c` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:17.973997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9515c6bbbc1b438d89b1cfaa0650833c)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:17.975843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.021238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9515c6bbbc1b438d89b1cfaa0650833c', 'request_id': 'req-8276217b-9708-4ad9-be8b-b4320598e243'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.027091 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9515c6bbbc1b438d89b1cfaa0650833c', 'request_id': 'req-8276217b-9708-4ad9-be8b-b4320598e243'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.033077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9515c6bbbc1b438d89b1cfaa0650833c', 'request_id': 'req-8276217b-9708-4ad9-be8b-b4320598e243'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.043597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] The token cache is being invalidate because project 9515c6bbbc1b438d89b1cfaa0650833c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:18.043817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.044429 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.045967 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1375/2732] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:17 2021] DELETE /identity/v3/projects/9515c6bbbc1b438d89b1cfaa0650833c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:18.049901 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.059091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608e980-c696-49d2-9766-62c9f1d49509 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.111646 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.112495 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.112778 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.113056 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] PATH_INFO: `/v3/users/2f1e905de1fa4cceb487d9b1e175cbd9` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.114185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1e905de1fa4cceb487d9b1e175cbd9)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.116143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.158483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1e905de1fa4cceb487d9b1e175cbd9'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.159147 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1e905de1fa4cceb487d9b1e175cbd9'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.166379 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1e905de1fa4cceb487d9b1e175cbd9'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.173143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1e905de1fa4cceb487d9b1e175cbd9'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.173741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8a008e23-156d-4c16-a4ab-5b3717fe7073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1e905de1fa4cceb487d9b1e175cbd9'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.190431 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1358/2733] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:18 2021] DELETE /identity/v3/users/2f1e905de1fa4cceb487d9b1e175cbd9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:18.462788 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.464337 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:18.476708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276217b-9708-4ad9-be8b-b4320598e243 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.531307 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.532158 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.532449 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.532727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] PATH_INFO: `/v3/projects/d8a6be59ea5645e3a89306684c2e776a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.533861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a6be59ea5645e3a89306684c2e776a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.535796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.580727 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a6be59ea5645e3a89306684c2e776a', 'request_id': 'req-41172566-9a05-4f2b-8002-b8eb8c41297d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.586262 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a6be59ea5645e3a89306684c2e776a', 'request_id': 'req-41172566-9a05-4f2b-8002-b8eb8c41297d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.593786 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a6be59ea5645e3a89306684c2e776a', 'request_id': 'req-41172566-9a05-4f2b-8002-b8eb8c41297d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.604527 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] The token cache is being invalidate because project d8a6be59ea5645e3a89306684c2e776a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:18.604817 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.605458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-41172566-9a05-4f2b-8002-b8eb8c41297d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:18.606993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1376/2734] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:18 2021] DELETE /identity/v3/projects/d8a6be59ea5645e3a89306684c2e776a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:18.612654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.612954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.613236 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.630396 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:18.631638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:18.687071 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1359/2735] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:18.694803 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.695123 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.695402 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.715391 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:18.716543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:18.724193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1377/2736] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:18.729069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.737853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1351b9-e8d5-460a-aa77-43c8fde96317 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.742128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.742775 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.743094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.743853 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.744573 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:18.744879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.746465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.757748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1360/2737] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:18:18.762518 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.770985 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beb9d8-283b-4187-8479-19fb75b4226f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.776041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.776680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.776964 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.777241 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.777925 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.779848 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.803824 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1378/2738] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:18 2021] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:18.807927 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.816839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b669-269c-461b-832d-f8e5513d4763 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.868997 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.869574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.869854 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.870131 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.870808 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.872724 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.892455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1361/2739] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:18 2021] POST /identity/v3/users => generated 283 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:18.896532 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.906339 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59640bbe-9813-42b1-8d56-7d12faf9f572 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.910760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.911438 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.911720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.911993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.912698 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.914268 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.924585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1379/2740] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:18.928319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.937837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee6b5e-d353-429a-beab-987058de33ed admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.942112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2612a-5c9f-424b-b326-347d5f06e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.942748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2612a-5c9f-424b-b326-347d5f06e911 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.943063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2612a-5c9f-424b-b326-347d5f06e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.943337 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2612a-5c9f-424b-b326-347d5f06e911 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.944044 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2612a-5c9f-424b-b326-347d5f06e911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.945618 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2612a-5c9f-424b-b326-347d5f06e911 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:18.955673 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1362/2741] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:18 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:18.959762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:18.968743 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9488-a047-4a8b-91cd-a5c427137842 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:18.972965 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:18.973823 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:18.974102 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:18.974371 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] PATH_INFO: `/v3/projects/47f6caa3660f409eb95631b9c9f3b6e3/users/f5245e0f2cc24cbe9e6060f1cdd8d568/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:18.988025 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f6caa3660f409eb95631b9c9f3b6e3, user_id=f5245e0f2cc24cbe9e6060f1cdd8d568, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:18.990618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.003572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1380/2742] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:18 2021] PUT /identity/v3/projects/47f6caa3660f409eb95631b9c9f3b6e3/users/f5245e0f2cc24cbe9e6060f1cdd8d568/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:19.015301 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.015716 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.015979 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.040878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] MFA Rules not processed for user `f5245e0f2cc24cbe9e6060f1cdd8d568`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:19.042031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:19.102223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1363/2743] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:19 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:19.107424 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.163345 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de63f0-0ac2-49ea-9a61-aa3af08e517a admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.168216 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.168854 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.169134 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.169408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.170074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.171993 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.195108 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1381/2744] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:19 2021] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:19.199060 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.209009 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb672-ef0f-4f4e-b11d-6bda1660561f None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.262426 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.263126 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.263411 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.263686 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.264370 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.266276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.285529 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1364/2745] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:19 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:19.289458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.299353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a571-d30d-47e8-8148-c269ac7c5846 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.303720 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.304368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.304649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.304922 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.305684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.307416 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.317541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1382/2746] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:19.321966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.331388 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92311ed6-37bc-4be8-9af5-a7ad005899a7 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.336028 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.337481 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.337765 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.338048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] PATH_INFO: `/v3/projects/c10e59ad65634b4e8a7e7fba10a15a61/users/a869c2c1040845648221f6a6ada4cfbd/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.352001 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10e59ad65634b4e8a7e7fba10a15a61, user_id=a869c2c1040845648221f6a6ada4cfbd, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.354746 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.367385 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1365/2747] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:19 2021] PUT /identity/v3/projects/c10e59ad65634b4e8a7e7fba10a15a61/users/a869c2c1040845648221f6a6ada4cfbd/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:19.371480 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.381067 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e295-faf9-4c56-a7eb-9ab1a7204c1e admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.434410 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b5f03-0822-4ade-9950-3f2f57fcd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.435015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5f03-0822-4ade-9950-3f2f57fcd994 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.435305 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5f03-0822-4ade-9950-3f2f57fcd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.435584 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5f03-0822-4ade-9950-3f2f57fcd994 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.436303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b5f03-0822-4ade-9950-3f2f57fcd994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.437895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b5f03-0822-4ade-9950-3f2f57fcd994 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.447874 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1383/2748] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:19 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:19.451981 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.461472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8958-4eb8-4aef-a260-bc03f1781177 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.466404 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.467296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.467574 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.467844 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] PATH_INFO: `/v3/projects/c10e59ad65634b4e8a7e7fba10a15a61/users/a869c2c1040845648221f6a6ada4cfbd/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.469644 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10e59ad65634b4e8a7e7fba10a15a61, user_id=a869c2c1040845648221f6a6ada4cfbd, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.472295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.482293 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1366/2749] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:19 2021] PUT /identity/v3/projects/c10e59ad65634b4e8a7e7fba10a15a61/users/a869c2c1040845648221f6a6ada4cfbd/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:19.492086 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.492564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.492660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.517562 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] MFA Rules not processed for user `a869c2c1040845648221f6a6ada4cfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:19.518704 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:19.580159 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1384/2750] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:19 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:19.590360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.592029 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:19.645789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d61c43-f199-42ed-aad3-b956a0e61c2c admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.649260 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.649982 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.650268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.650540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.658718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.660181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.669102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1367/2751] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:19 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:19.735130 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:19.744742 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e6992-b6dc-4587-8704-51ba2b83cfaf None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:19.748214 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a431a-4070-46ff-9440-5c5c5ddc60ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:19.748851 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a431a-4070-46ff-9440-5c5c5ddc60ba service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:19.749142 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a431a-4070-46ff-9440-5c5c5ddc60ba service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:19.749421 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a431a-4070-46ff-9440-5c5c5ddc60ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:19.804347 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a431a-4070-46ff-9440-5c5c5ddc60ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:19.806660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a431a-4070-46ff-9440-5c5c5ddc60ba service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:19.815246 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1385/2752] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:19 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:22.444947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:22.504711 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268cfae-28f8-45ed-af9c-06ac806dbb8b service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:22.509401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:22.510252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:22.510533 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:22.510807 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] PATH_INFO: `/v3/users/f5245e0f2cc24cbe9e6060f1cdd8d568` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:22.511968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5245e0f2cc24cbe9e6060f1cdd8d568)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:22.513880 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:22.558857 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5245e0f2cc24cbe9e6060f1cdd8d568'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:22.559536 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5245e0f2cc24cbe9e6060f1cdd8d568'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:22.566380 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5245e0f2cc24cbe9e6060f1cdd8d568'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:22.574308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5245e0f2cc24cbe9e6060f1cdd8d568'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:22.575089 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5245e0f2cc24cbe9e6060f1cdd8d568'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:22.591788 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1368/2753] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:22 2021] DELETE /identity/v3/users/f5245e0f2cc24cbe9e6060f1cdd8d568 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:22.596277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:22.596757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:22.596856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:22.613303 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:22.614452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:22.670192 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1386/2754] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:22.679750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:22.681669 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:22.735756 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fced9-8208-40c7-a547-93bc1254446b admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:22.739161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:22.739787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:22.740066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:22.740336 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:22.748595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:22.750004 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:22.758470 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1369/2755] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:23.036061 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:23.037728 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:23.049628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2c04-4f9c-4cc8-bd93-e91fe1afcb71 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:23.054517 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:23.055991 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.056283 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.056585 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] PATH_INFO: `/v3/projects/47f6caa3660f409eb95631b9c9f3b6e3` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.057843 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f6caa3660f409eb95631b9c9f3b6e3)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:23.059834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:23.108785 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f6caa3660f409eb95631b9c9f3b6e3', 'request_id': 'req-257b3d65-d98b-4175-8d3a-a0a0a3127c60'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.114224 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f6caa3660f409eb95631b9c9f3b6e3', 'request_id': 'req-257b3d65-d98b-4175-8d3a-a0a0a3127c60'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.124464 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f6caa3660f409eb95631b9c9f3b6e3', 'request_id': 'req-257b3d65-d98b-4175-8d3a-a0a0a3127c60'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.136765 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] The token cache is being invalidate because project 47f6caa3660f409eb95631b9c9f3b6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:23.137068 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.138588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.140489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1387/2756] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:23 2021] DELETE /identity/v3/projects/47f6caa3660f409eb95631b9c9f3b6e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:23.144303 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:23.153848 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933e77-5c2e-44e0-a21c-5f4cb7f1cf34 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:23.213543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:23.214421 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.214705 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.215075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] PATH_INFO: `/v3/users/a869c2c1040845648221f6a6ada4cfbd` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.216216 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a869c2c1040845648221f6a6ada4cfbd)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:23.218143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:23.269976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a869c2c1040845648221f6a6ada4cfbd'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.270624 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a869c2c1040845648221f6a6ada4cfbd'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.277784 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a869c2c1040845648221f6a6ada4cfbd'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.284675 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a869c2c1040845648221f6a6ada4cfbd'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.285304 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-24de5bd2-1cad-4637-8862-59c51dcc6625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a869c2c1040845648221f6a6ada4cfbd'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.303483 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1370/2757] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:23 2021] DELETE /identity/v3/users/a869c2c1040845648221f6a6ada4cfbd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:23.595177 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:23.596579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:23.610927 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b3d65-d98b-4175-8d3a-a0a0a3127c60 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:23.667828 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:23.668699 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.668997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.669377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] PATH_INFO: `/v3/projects/c10e59ad65634b4e8a7e7fba10a15a61` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.670426 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10e59ad65634b4e8a7e7fba10a15a61)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:23.672380 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:23.716650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10e59ad65634b4e8a7e7fba10a15a61', 'request_id': 'req-04845d09-8b04-45a3-9091-f3cf594e11be'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.721762 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10e59ad65634b4e8a7e7fba10a15a61', 'request_id': 'req-04845d09-8b04-45a3-9091-f3cf594e11be'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.728936 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10e59ad65634b4e8a7e7fba10a15a61', 'request_id': 'req-04845d09-8b04-45a3-9091-f3cf594e11be'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.739589 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] The token cache is being invalidate because project c10e59ad65634b4e8a7e7fba10a15a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:23.739875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.740497 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-04845d09-8b04-45a3-9091-f3cf594e11be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:23.742040 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1388/2758] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:23 2021] DELETE /identity/v3/projects/c10e59ad65634b4e8a7e7fba10a15a61 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:23.747723 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.748175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.748266 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.764699 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:23.765839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:23.820435 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1371/2759] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:23.828680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.828970 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.829248 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.846755 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:23.847949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:23.855650 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1389/2760] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:23.859541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:23.868662 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd4892-e8c1-4823-91a5-4b0c4aad9eb8 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:23.872878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:23.873510 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.873787 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.874058 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.874759 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:23.875098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:23.876676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:23.887702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1372/2761] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:23.891721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:23.900098 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a93a-373c-4609-a19a-09f6360378db None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:23.904482 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:23.905115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:23.905398 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:23.905671 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:23.906358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:23.908273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:23.934963 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1390/2762] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:23 2021] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:23.938064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:23.949508 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037017-10fc-43d8-acbb-1dca3c314041 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.005296 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.005950 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.006237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.006513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.007223 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.009172 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.027457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1373/2763] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:23 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:24.031560 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.041739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3340-5ff5-4c68-baf8-7fc4dac3c53c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.046060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.046706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.047024 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.047311 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.048022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.049597 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.060227 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1391/2764] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:24.064055 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.073226 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6c982-6436-4857-bf3e-53b7398098de admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.077532 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57791597-f57b-4a6e-af0e-e4c8ffbe2eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.078175 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57791597-f57b-4a6e-af0e-e4c8ffbe2eef admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.078462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57791597-f57b-4a6e-af0e-e4c8ffbe2eef admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.078741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57791597-f57b-4a6e-af0e-e4c8ffbe2eef admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.079503 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57791597-f57b-4a6e-af0e-e4c8ffbe2eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.081422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57791597-f57b-4a6e-af0e-e4c8ffbe2eef admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.091277 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1374/2765] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:24.095266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.105149 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e3e26-b20f-45aa-bec1-04b38c36c1a5 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.109690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.110591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.110877 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.111187 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] PATH_INFO: `/v3/projects/fb233686ab5c4ee18662bd36510ffa7b/users/eff96fcb20c3408eafe7a334c0b57c0f/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.125555 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb233686ab5c4ee18662bd36510ffa7b, user_id=eff96fcb20c3408eafe7a334c0b57c0f, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.128254 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.140500 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1392/2766] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:24 2021] PUT /identity/v3/projects/fb233686ab5c4ee18662bd36510ffa7b/users/eff96fcb20c3408eafe7a334c0b57c0f/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:24.193466 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.193757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.194040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.221718 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] MFA Rules not processed for user `eff96fcb20c3408eafe7a334c0b57c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:24.222883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:24.285757 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1375/2767] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:24.291001 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.349829 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac756-e9ef-4a75-a513-607cb7a03664 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.354784 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.355489 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.355768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.356036 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.356739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.358621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.382576 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1393/2768] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:24 2021] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:24.386958 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.397040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0a4fb-b416-4729-853a-b2eb06c10366 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.450111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.450777 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.451254 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.451430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.452171 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.454203 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.477048 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1376/2769] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:24 2021] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:24.479176 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.488692 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717addc-92cc-4697-a930-1aa76ad32382 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.496185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.496845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.497127 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.497399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.498150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.499825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.510673 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1394/2770] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:24.515069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.525156 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d2b9-e908-42dd-b33d-82494602895e admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.529609 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.530513 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.530794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.531102 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] PATH_INFO: `/v3/projects/09d7e56760434fd5a5c906b01a2d167e/users/f307a7c11b9742b2a0d77d59151c3f10/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.546433 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d7e56760434fd5a5c906b01a2d167e, user_id=f307a7c11b9742b2a0d77d59151c3f10, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.549166 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.563829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1377/2771] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:24 2021] PUT /identity/v3/projects/09d7e56760434fd5a5c906b01a2d167e/users/f307a7c11b9742b2a0d77d59151c3f10/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:24.567873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.578747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ca16-353f-4a7a-968c-a096c0cee1ee admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.637613 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe446f7-46b1-414d-b2fc-ba272daaa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.638602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe446f7-46b1-414d-b2fc-ba272daaa6ba admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.639051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe446f7-46b1-414d-b2fc-ba272daaa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.639418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe446f7-46b1-414d-b2fc-ba272daaa6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.640289 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe446f7-46b1-414d-b2fc-ba272daaa6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.642551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe446f7-46b1-414d-b2fc-ba272daaa6ba admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.654862 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1395/2772] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:24 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:24.659191 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.669485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7476cc-1dbf-4433-8468-9c97fc4f3a84 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.674371 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.675270 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.675555 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.675858 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] PATH_INFO: `/v3/projects/09d7e56760434fd5a5c906b01a2d167e/users/f307a7c11b9742b2a0d77d59151c3f10/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.677735 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d7e56760434fd5a5c906b01a2d167e, user_id=f307a7c11b9742b2a0d77d59151c3f10, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.681054 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.691362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1378/2773] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:24 2021] PUT /identity/v3/projects/09d7e56760434fd5a5c906b01a2d167e/users/f307a7c11b9742b2a0d77d59151c3f10/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:24.701594 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.701889 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.702163 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.727684 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] MFA Rules not processed for user `f307a7c11b9742b2a0d77d59151c3f10`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:24.728834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:24.792897 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1396/2774] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:24 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:24.802491 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.804227 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:24.870374 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacea73-2d21-4c6a-b9e4-2d836cdfbddc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.873823 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.874455 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.874734 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.875041 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:24.883290 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:24.885213 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:24.893800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1379/2775] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:24 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:24.936055 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:24.937437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:24.949393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fcdc-ab83-4721-990c-669113ca23f3 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:24.952834 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72c1b1-a80f-4e8e-a11d-01340ce88f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:24.953469 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c1b1-a80f-4e8e-a11d-01340ce88f8f service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:24.953757 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c1b1-a80f-4e8e-a11d-01340ce88f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:24.954034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c1b1-a80f-4e8e-a11d-01340ce88f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:25.008109 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c1b1-a80f-4e8e-a11d-01340ce88f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:25.010267 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c1b1-a80f-4e8e-a11d-01340ce88f8f service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:25.018458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1397/2776] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:24 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:30.317110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:30.375964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d692957-7724-4b5e-a832-778213c39e8d service cinder] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:30.380151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:30.380993 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:30.381271 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:30.381542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] PATH_INFO: `/v3/users/eff96fcb20c3408eafe7a334c0b57c0f` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:30.382641 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff96fcb20c3408eafe7a334c0b57c0f)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:30.385160 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:30.426328 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff96fcb20c3408eafe7a334c0b57c0f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.426968 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff96fcb20c3408eafe7a334c0b57c0f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.434137 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff96fcb20c3408eafe7a334c0b57c0f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.440824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff96fcb20c3408eafe7a334c0b57c0f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.441447 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff96fcb20c3408eafe7a334c0b57c0f'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.458849 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1380/2777] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:30 2021] DELETE /identity/v3/users/eff96fcb20c3408eafe7a334c0b57c0f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:30.463379 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:30.463880 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:30.464015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:30.480508 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:30.481666 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:30.536264 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1398/2778] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:30.546310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:30.547663 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:30.602390 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716120-7d8d-4faf-94e0-f2d9d530d433 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:30.605850 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:30.606490 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:30.606806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:30.607122 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:30.615790 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:30.617233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:30.626031 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1381/2779] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:30.888104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:30.889458 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:30.901689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ff27-5458-4b66-a7e8-e7707f916ec7 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:30.906005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:30.906863 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:30.907181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:30.907452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] PATH_INFO: `/v3/projects/fb233686ab5c4ee18662bd36510ffa7b` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:30.909760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb233686ab5c4ee18662bd36510ffa7b)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:30.911696 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:30.956960 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb233686ab5c4ee18662bd36510ffa7b', 'request_id': 'req-f3a32cbf-8485-426e-b00b-6eb37d301ed8'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.962677 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb233686ab5c4ee18662bd36510ffa7b', 'request_id': 'req-f3a32cbf-8485-426e-b00b-6eb37d301ed8'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.969247 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb233686ab5c4ee18662bd36510ffa7b', 'request_id': 'req-f3a32cbf-8485-426e-b00b-6eb37d301ed8'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.980047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] The token cache is being invalidate because project fb233686ab5c4ee18662bd36510ffa7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:30.980329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.980935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:30.982437 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1399/2780] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:30 2021] DELETE /identity/v3/projects/fb233686ab5c4ee18662bd36510ffa7b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:30.986443 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:30.995339 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb2d82-61a1-487d-9c94-258fc70911c6 service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.048185 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.049038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.049317 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.049588 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] PATH_INFO: `/v3/users/f307a7c11b9742b2a0d77d59151c3f10` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.050753 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f307a7c11b9742b2a0d77d59151c3f10)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.052966 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.096249 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f307a7c11b9742b2a0d77d59151c3f10'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.096885 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f307a7c11b9742b2a0d77d59151c3f10'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.104112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f307a7c11b9742b2a0d77d59151c3f10'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.110879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f307a7c11b9742b2a0d77d59151c3f10'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.111542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-ea377e58-bfe0-4336-99a5-41fa13064685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f307a7c11b9742b2a0d77d59151c3f10'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.128188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1382/2781] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:30 2021] DELETE /identity/v3/users/f307a7c11b9742b2a0d77d59151c3f10 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:31.409112 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.410231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:31.430605 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a32cbf-8485-426e-b00b-6eb37d301ed8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.485736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.486588 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.486873 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.487179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] PATH_INFO: `/v3/projects/09d7e56760434fd5a5c906b01a2d167e` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.488331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d7e56760434fd5a5c906b01a2d167e)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.490232 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.533976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d7e56760434fd5a5c906b01a2d167e', 'request_id': 'req-c19f7033-6bdd-494d-8d60-41182b39f603'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.539132 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d7e56760434fd5a5c906b01a2d167e', 'request_id': 'req-c19f7033-6bdd-494d-8d60-41182b39f603'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.545979 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d7e56760434fd5a5c906b01a2d167e', 'request_id': 'req-c19f7033-6bdd-494d-8d60-41182b39f603'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.556663 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] The token cache is being invalidate because project 09d7e56760434fd5a5c906b01a2d167e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:31.556930 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.557557 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-c19f7033-6bdd-494d-8d60-41182b39f603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:31.559079 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1400/2782] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:31 2021] DELETE /identity/v3/projects/09d7e56760434fd5a5c906b01a2d167e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:31.564739 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.565180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.565376 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.582801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:31.584005 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:31.638647 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1383/2783] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:31.647385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.647678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.647958 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.665875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:31.667044 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:31.674300 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1401/2784] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:31.678233 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.687789 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344bd75-ea7e-412c-9e7f-a093a9139b65 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.692075 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.692721 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.693007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.693281 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.693998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:31.694307 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.696183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.707661 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1384/2785] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:31.712150 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.720377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862f093-706c-4fb1-a423-dc45090842b5 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.724614 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.725243 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.725528 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.725795 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.726470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.728947 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.752375 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1402/2786] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:31 2021] POST /identity/v3/projects => generated 385 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:31.756362 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.765252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728813-9f96-4c71-ab74-8232924726c3 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.818740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.819422 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.819703 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.819976 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.820758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.822717 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.843000 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1385/2787] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:31 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:31.847154 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.856747 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1559883-d851-4cc8-834d-2240bf96f355 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.861070 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.861708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.861997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.862275 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.863022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.864612 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.875266 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1403/2788] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:31.879177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.888969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b00f-6321-4dad-8548-a8c510c2ce70 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.893239 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028039f-0c68-4cdd-ae95-a866c794515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.893875 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028039f-0c68-4cdd-ae95-a866c794515c admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.894153 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028039f-0c68-4cdd-ae95-a866c794515c admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.894427 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028039f-0c68-4cdd-ae95-a866c794515c admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.895164 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028039f-0c68-4cdd-ae95-a866c794515c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.896741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028039f-0c68-4cdd-ae95-a866c794515c admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.906801 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1386/2789] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:31.910442 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:31.920033 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318c972-6fe2-402b-9a10-75c19a3530b8 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:31.924336 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:31.925203 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.925490 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.925769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] PATH_INFO: `/v3/projects/9bfca2b198cc4e82914ad63f7690536f/users/ae82868268ce4e7bada1a1cf7e2a61ba/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.940273 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfca2b198cc4e82914ad63f7690536f, user_id=ae82868268ce4e7bada1a1cf7e2a61ba, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:31.942898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:31.955815 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1404/2790] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:31 2021] PUT /identity/v3/projects/9bfca2b198cc4e82914ad63f7690536f/users/ae82868268ce4e7bada1a1cf7e2a61ba/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:31.965654 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:31.965957 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:31.966230 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:31.992163 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] MFA Rules not processed for user `ae82868268ce4e7bada1a1cf7e2a61ba`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:31.993839 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:32.056542 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1387/2791] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:31 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:32.060637 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.119427 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4b143-98d4-4e64-ab97-72bdc499c592 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.124077 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.124739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.125026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.125306 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.125997 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.127938 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.153064 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1405/2792] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:32 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:32.157264 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.167978 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81d67-459d-48e2-a7db-21dd709c289e None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.220816 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.221472 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.221761 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.222038 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.222725 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.224676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.247990 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1388/2793] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:32 2021] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:32.252065 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.262193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397de2b-8a3a-4133-81ac-f2f8ad687c0d admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.266731 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.267453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.267761 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.268051 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.268769 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.270358 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.280946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1406/2794] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:32.285112 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.295027 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afbb35-bf31-4933-863d-3d11d3a472dc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.299956 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.300840 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.301128 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.301401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] PATH_INFO: `/v3/projects/69aaf5a952ef4d91b685faaae0d8b675/users/82e3a5b0fa0a4a80b1e8d9d3dedf65a7/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.317899 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aaf5a952ef4d91b685faaae0d8b675, user_id=82e3a5b0fa0a4a80b1e8d9d3dedf65a7, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.320621 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.334205 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1389/2795] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:32 2021] PUT /identity/v3/projects/69aaf5a952ef4d91b685faaae0d8b675/users/82e3a5b0fa0a4a80b1e8d9d3dedf65a7/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:32.338286 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.347875 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2550-63f2-4485-856b-dabb24f992f7 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.401713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d895-ebf2-4b12-8527-133d4cc0bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.402385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d895-ebf2-4b12-8527-133d4cc0bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.402669 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d895-ebf2-4b12-8527-133d4cc0bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.402976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d895-ebf2-4b12-8527-133d4cc0bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.403778 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9d895-ebf2-4b12-8527-133d4cc0bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.405309 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9d895-ebf2-4b12-8527-133d4cc0bcfc admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.415468 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1407/2796] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:32.419639 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.429348 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2c404-02df-40b7-a42e-320182afbf6f admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.434594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.435569 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.435902 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.436186 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] PATH_INFO: `/v3/projects/69aaf5a952ef4d91b685faaae0d8b675/users/82e3a5b0fa0a4a80b1e8d9d3dedf65a7/roles/620fb448cda4468da4c7442522368bea` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.438125 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aaf5a952ef4d91b685faaae0d8b675, user_id=82e3a5b0fa0a4a80b1e8d9d3dedf65a7, role_id=620fb448cda4468da4c7442522368bea)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.440796 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.451132 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1390/2797] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:32 2021] PUT /identity/v3/projects/69aaf5a952ef4d91b685faaae0d8b675/users/82e3a5b0fa0a4a80b1e8d9d3dedf65a7/roles/620fb448cda4468da4c7442522368bea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:32.463329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.463624 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.463905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.490645 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] MFA Rules not processed for user `82e3a5b0fa0a4a80b1e8d9d3dedf65a7`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:32.491845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:32.560365 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1408/2798] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:32 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:32.569702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:32.571456 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:32.631098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6288-2a1b-40a5-be59-ece48323c180 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:32.634577 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056947e-45c0-4389-9932-ac2ff11fd09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:32.635242 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056947e-45c0-4389-9932-ac2ff11fd09f service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:32.635521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056947e-45c0-4389-9932-ac2ff11fd09f service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:32.635792 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056947e-45c0-4389-9932-ac2ff11fd09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:32.644065 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056947e-45c0-4389-9932-ac2ff11fd09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:32.645480 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056947e-45c0-4389-9932-ac2ff11fd09f service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:32.654678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1391/2799] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:32 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:33.127525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.186687 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9df25e-65e1-48fb-8ba2-7f554e27c14f None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:33.190887 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:33.191768 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.192053 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.192331 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] PATH_INFO: `/v3/users/ae82868268ce4e7bada1a1cf7e2a61ba` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.193472 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae82868268ce4e7bada1a1cf7e2a61ba)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:33.195422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:33.238543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae82868268ce4e7bada1a1cf7e2a61ba'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.245949 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae82868268ce4e7bada1a1cf7e2a61ba'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.246628 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae82868268ce4e7bada1a1cf7e2a61ba'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.257721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae82868268ce4e7bada1a1cf7e2a61ba'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.265351 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae82868268ce4e7bada1a1cf7e2a61ba'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.271193 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1409/2800] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:33 2021] DELETE /identity/v3/users/ae82868268ce4e7bada1a1cf7e2a61ba => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:33.276040 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.276335 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.276613 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.292534 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:33.293693 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:33.348268 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1392/2801] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:33.358047 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.359512 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:33.381188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.382548 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:33.394035 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692868c-8ec7-4190-8c37-a2c0821392bf None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:33.398350 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:33.399240 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.399521 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.399806 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] PATH_INFO: `/v3/users/743947c0778e4afe9b2b8795caa9a3a4` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.401158 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743947c0778e4afe9b2b8795caa9a3a4)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:33.403111 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:33.416802 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334c4c-ce5c-4588-ba14-a72eb116bef9 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:33.420362 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bf393-75b4-4d38-9d1f-fd6a21e82d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:33.421005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf393-75b4-4d38-9d1f-fd6a21e82d97 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.421291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf393-75b4-4d38-9d1f-fd6a21e82d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.421568 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf393-75b4-4d38-9d1f-fd6a21e82d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.430325 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bf393-75b4-4d38-9d1f-fd6a21e82d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:33.432543 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bf393-75b4-4d38-9d1f-fd6a21e82d97 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:33.441706 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1410/2802] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:33.447932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743947c0778e4afe9b2b8795caa9a3a4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.448748 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743947c0778e4afe9b2b8795caa9a3a4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.455655 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743947c0778e4afe9b2b8795caa9a3a4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.462347 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743947c0778e4afe9b2b8795caa9a3a4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.463196 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743947c0778e4afe9b2b8795caa9a3a4'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.480653 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1393/2803] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:33 2021] DELETE /identity/v3/users/743947c0778e4afe9b2b8795caa9a3a4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:33.485369 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.485702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.485982 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.503910 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:33.505074 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:33.562905 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1411/2804] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:33.572970 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.574373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:33.630265 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9506282-73b2-4857-a661-13f051cb03f6 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:33.633750 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:33.634397 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.635262 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.635595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.644294 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:33.645811 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:33.655550 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1394/2805] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:33.753151 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.754639 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:33.768231 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c9f7-dfdb-489e-8ff9-5bea0dcb89d6 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:33.773641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:33.774492 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.774853 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.775804 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] PATH_INFO: `/v3/projects/9bfca2b198cc4e82914ad63f7690536f` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.777085 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfca2b198cc4e82914ad63f7690536f)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:33.780089 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:33.825966 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfca2b198cc4e82914ad63f7690536f', 'request_id': 'req-907ed234-b803-46aa-a75d-52d511594f10'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.831387 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfca2b198cc4e82914ad63f7690536f', 'request_id': 'req-907ed234-b803-46aa-a75d-52d511594f10'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.839189 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfca2b198cc4e82914ad63f7690536f', 'request_id': 'req-907ed234-b803-46aa-a75d-52d511594f10'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.850026 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] The token cache is being invalidate because project 9bfca2b198cc4e82914ad63f7690536f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:33.850436 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.851206 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.852895 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1412/2806] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:33 2021] DELETE /identity/v3/projects/9bfca2b198cc4e82914ad63f7690536f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:33.856973 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.866042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05859d82-6123-4ecf-88cc-be3e0d2f30bd service neutron] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:33.919878 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:33.920749 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:33.921034 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:33.921311 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] PATH_INFO: `/v3/users/82e3a5b0fa0a4a80b1e8d9d3dedf65a7` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:33.922452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e3a5b0fa0a4a80b1e8d9d3dedf65a7)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:33.924468 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:33.972332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e3a5b0fa0a4a80b1e8d9d3dedf65a7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.973018 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e3a5b0fa0a4a80b1e8d9d3dedf65a7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.980165 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e3a5b0fa0a4a80b1e8d9d3dedf65a7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.987502 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e3a5b0fa0a4a80b1e8d9d3dedf65a7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.990700 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-0ed872fa-0021-4b81-b682-b3209a3d43d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e3a5b0fa0a4a80b1e8d9d3dedf65a7'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:33.991495 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:33.993013 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.006636 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed234-b803-46aa-a75d-52d511594f10 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.011269 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1395/2807] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:33 2021] DELETE /identity/v3/users/82e3a5b0fa0a4a80b1e8d9d3dedf65a7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:34.012084 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.013015 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.013304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.013659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] PATH_INFO: `/v3/projects/aacd8603c0754173a6b1a1c7e9d5ef96` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.014838 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacd8603c0754173a6b1a1c7e9d5ef96)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.016796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.066591 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacd8603c0754173a6b1a1c7e9d5ef96', 'request_id': 'req-4932f5c6-c670-48d7-a3c7-3defac1b952d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.073882 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacd8603c0754173a6b1a1c7e9d5ef96', 'request_id': 'req-4932f5c6-c670-48d7-a3c7-3defac1b952d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.080976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacd8603c0754173a6b1a1c7e9d5ef96', 'request_id': 'req-4932f5c6-c670-48d7-a3c7-3defac1b952d'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.092338 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] The token cache is being invalidate because project aacd8603c0754173a6b1a1c7e9d5ef96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:34.092635 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.093377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4932f5c6-c670-48d7-a3c7-3defac1b952d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.098760 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1413/2808] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:33 2021] DELETE /identity/v3/projects/aacd8603c0754173a6b1a1c7e9d5ef96 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:34.104918 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.105310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.105594 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.123133 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:34.124322 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.182999 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1396/2809] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:34.191316 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.191678 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.192022 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.212513 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:34.214178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.221648 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1414/2810] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:34.226084 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.235099 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c61ab-94ac-426f-9fa8-4fccaa207f17 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.239512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.240187 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.240475 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.240754 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.241482 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:34.241791 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.243423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.259948 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1397/2811] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:18:34.261114 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.270008 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ec5c-8b94-49ed-b2f4-d804ebde67fe None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.275075 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.276006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.276393 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.276766 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] PATH_INFO: `/v3/projects` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.277467 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.279404 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.300219 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.301974 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.306396 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1415/2812] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:34.311883 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.317007 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c94e-d02a-433d-a9d0-f5a3a26ba2dc admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.371951 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091054-39b9-42d6-a2f3-bf337e39c775 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.375094 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.376315 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.376470 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.376610 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.377138 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.377283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] PATH_INFO: `/v3/projects/69aaf5a952ef4d91b685faaae0d8b675` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.377423 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.377702 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.378383 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.378485 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69aaf5a952ef4d91b685faaae0d8b675)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.380382 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.380493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.403011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1416/2813] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:34.405165 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.414104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd171e-ce2c-4377-b618-6d9a4e6bb533 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.427224 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69aaf5a952ef4d91b685faaae0d8b675', 'request_id': 'req-eb4ea86e-d337-4273-ba75-e332896e8636'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.433162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69aaf5a952ef4d91b685faaae0d8b675', 'request_id': 'req-eb4ea86e-d337-4273-ba75-e332896e8636'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.440736 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69aaf5a952ef4d91b685faaae0d8b675', 'request_id': 'req-eb4ea86e-d337-4273-ba75-e332896e8636'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.455991 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] The token cache is being invalidate because project 69aaf5a952ef4d91b685faaae0d8b675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:34.456276 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.456919 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-eb4ea86e-d337-4273-ba75-e332896e8636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:34.458488 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1398/2814] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:34 2021] DELETE /identity/v3/projects/69aaf5a952ef4d91b685faaae0d8b675 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:34.464109 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c38e5-17b4-4316-bfce-798c4752ec0a None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.464399 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c38e5-17b4-4316-bfce-798c4752ec0a None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.464680 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c38e5-17b4-4316-bfce-798c4752ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.471845 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.472509 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.472793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.473066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.473783 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.475434 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.482310 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-5e4c38e5-17b4-4316-bfce-798c4752ec0a None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:34.483546 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-5e4c38e5-17b4-4316-bfce-798c4752ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.488525 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1417/2815] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:18:34.489486 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.491011 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.498274 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1399/2816] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:34.499679 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.499969 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.500245 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.502599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294e1d1-2f15-4233-82da-8a5aeb6cb368 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.507006 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.507659 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.507942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.508219 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.508926 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.511183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.518409 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:34.519593 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.521124 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1418/2817] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:34.525104 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.527405 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1400/2818] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:34.531355 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.534115 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448139e-37fc-4fae-8795-79173f623876 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.538481 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352ab04-e13f-4e86-a1e9-4d08e42f375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.539374 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352ab04-e13f-4e86-a1e9-4d08e42f375a admin admin] REQUEST_METHOD: `PUT` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.539486 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac872-de8d-43f1-8589-3070099339fd None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.539660 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352ab04-e13f-4e86-a1e9-4d08e42f375a admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.539946 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352ab04-e13f-4e86-a1e9-4d08e42f375a admin admin] PATH_INFO: `/v3/projects/6c2bff858ea84c0bbd64923029cdb27d/users/5b69463c446f4878b0fbe0113d57d848/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.544657 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.545287 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.545565 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.545834 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.546543 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:18:34.546846 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.548467 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.554819 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352ab04-e13f-4e86-a1e9-4d08e42f375a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2bff858ea84c0bbd64923029cdb27d, user_id=5b69463c446f4878b0fbe0113d57d848, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.558244 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352ab04-e13f-4e86-a1e9-4d08e42f375a admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.560545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1401/2819] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:18:34.565174 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.573581 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1419/2820] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:34 2021] PUT /identity/v3/projects/6c2bff858ea84c0bbd64923029cdb27d/users/5b69463c446f4878b0fbe0113d57d848/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:34.574188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b089c-0427-4cbb-ac1e-49a8fe7fc2ac admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.584603 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.584898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.585183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.611548 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] MFA Rules not processed for user `5b69463c446f4878b0fbe0113d57d848`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:34.613175 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.628592 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.629255 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.629540 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.629820 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.630509 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.632453 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.659069 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1402/2821] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:18:34.663141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.680935 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1420/2822] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:34.690756 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.692093 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.722314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdb88-296e-4a63-a6d8-9f15d968d6f4 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.726640 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.727332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.727620 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.727892 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] PATH_INFO: `/v3/users` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.729183 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.731119 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.746360 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130685b2-4a93-4f23-810c-7f487f6c88a0 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.751013 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1403/2823] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:18:34.754967 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.764401 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205de89-e771-4e0c-bd1b-ac5bd64f138d admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.768800 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.769436 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.769722 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.769998 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.770702 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.772332 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.782856 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1404/2824] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:34.786580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.795541 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e146d1-da0d-4f1a-91a0-53a41a5b99ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.795964 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865080e-1aaa-45a3-ba4c-7ee5a92f6168 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.796185 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e146d1-da0d-4f1a-91a0-53a41a5b99ca service cinder] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.796465 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e146d1-da0d-4f1a-91a0-53a41a5b99ca service cinder] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.796737 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e146d1-da0d-4f1a-91a0-53a41a5b99ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.800373 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.801011 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.801297 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.801575 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.802283 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.803928 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.813954 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1405/2825] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:18:34.817841 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.827758 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e745-8f54-4917-99ce-caea4bc18e98 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:34.832674 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:34.833522 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.833815 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.834093 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] PATH_INFO: `/v3/projects/3340cc2d5bb0464a96a9f50f704541bb/users/4bd5a01544f04f958cac03cd334ba26a/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.848008 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3340cc2d5bb0464a96a9f50f704541bb, user_id=4bd5a01544f04f958cac03cd334ba26a, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.850643 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.851796 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e146d1-da0d-4f1a-91a0-53a41a5b99ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:34.853234 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e146d1-da0d-4f1a-91a0-53a41a5b99ca service cinder] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:34.862066 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1421/2826] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:34.865091 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1406/2827] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:18:34 2021] PUT /identity/v3/projects/3340cc2d5bb0464a96a9f50f704541bb/users/4bd5a01544f04f958cac03cd334ba26a/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:18:34.875376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:34.875719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:34.875924 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:34.901454 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] MFA Rules not processed for user `4bd5a01544f04f958cac03cd334ba26a`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:34.902611 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:34.964709 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1422/2828] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:18:34.974764 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:34.976559 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:35.035947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68dd0-6995-417e-89d8-5c9718f48632 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:35.039545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02dad6-49f0-4ba7-adfc-c9d58096538c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:35.040188 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02dad6-49f0-4ba7-adfc-c9d58096538c service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:35.040471 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02dad6-49f0-4ba7-adfc-c9d58096538c service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:35.040835 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02dad6-49f0-4ba7-adfc-c9d58096538c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:35.049055 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02dad6-49f0-4ba7-adfc-c9d58096538c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:35.050837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02dad6-49f0-4ba7-adfc-c9d58096538c service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:35.059006 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1407/2829] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:34 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:18:35.079649 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:35.153976 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4b33b-7c52-42a8-996e-1ccb9f3795b4 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:35.158806 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:35.159721 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:35.160005 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:35.160277 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] PATH_INFO: `/v3/users/4bd5a01544f04f958cac03cd334ba26a` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:35.161425 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd5a01544f04f958cac03cd334ba26a)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:35.163408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:35.208250 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd5a01544f04f958cac03cd334ba26a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.215408 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd5a01544f04f958cac03cd334ba26a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.216146 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd5a01544f04f958cac03cd334ba26a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.227621 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd5a01544f04f958cac03cd334ba26a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.236106 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd5a01544f04f958cac03cd334ba26a'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.242460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1423/2830] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:18:35 2021] DELETE /identity/v3/users/4bd5a01544f04f958cac03cd334ba26a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:18:35.247595 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:35.247884 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:35.248181 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:35.264740 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:18:35.265932 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:35.323151 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1408/2831] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:18:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:18:35.333261 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:35.334618 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:35.392856 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516eec9-6ec9-4d9f-a661-e63add36e95c admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:35.396353 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:35.397020 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:35.397304 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:35.397579 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:35.406551 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:35.408010 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:35.417344 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1424/2832] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:18:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:18:35.689036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:18:35.690476 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:18:35.703378 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b81e-9e19-449d-b8ec-3848ee7b5656 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:18:35.708063 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:18:35.708915 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:18:35.709194 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:18:35.709465 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] PATH_INFO: `/v3/projects/3340cc2d5bb0464a96a9f50f704541bb` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:18:35.711552 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3340cc2d5bb0464a96a9f50f704541bb)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:18:35.713487 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:18:35.757498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3340cc2d5bb0464a96a9f50f704541bb', 'request_id': 'req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.762805 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3340cc2d5bb0464a96a9f50f704541bb', 'request_id': 'req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.769526 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3340cc2d5bb0464a96a9f50f704541bb', 'request_id': 'req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.780874 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] The token cache is being invalidate because project 3340cc2d5bb0464a96a9f50f704541bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:18:35.781162 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.781786 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-4e486a2f-4ef1-49df-99a5-104fb5cfe3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:18:35.783308 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1409/2833] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:18:35 2021] DELETE /identity/v3/projects/3340cc2d5bb0464a96a9f50f704541bb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:19:11.726119 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:11.727488 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:11.739793 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342eb1d-1ac8-4109-a663-a6d9aeef11d9 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:11.791041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:11.791898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:11.792178 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:11.792453 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] PATH_INFO: `/v3/users/5b69463c446f4878b0fbe0113d57d848` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:11.793572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b69463c446f4878b0fbe0113d57d848)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:11.795502 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:11.837590 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b69463c446f4878b0fbe0113d57d848'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:11.844072 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b69463c446f4878b0fbe0113d57d848'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:11.844713 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b69463c446f4878b0fbe0113d57d848'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:11.856599 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b69463c446f4878b0fbe0113d57d848'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:11.865054 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b69463c446f4878b0fbe0113d57d848'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:11.870719 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1425/2834] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:19:11 2021] DELETE /identity/v3/users/5b69463c446f4878b0fbe0113d57d848 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:19:11.875351 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:11.875852 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:11.875949 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:11.892838 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:19:11.894545 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:11.949460 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1410/2835] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:19:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:19:11.959110 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:11.960440 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:12.014200 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc362496-d97f-440b-b54b-5cea3be3c189 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.017681 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a28a3d-d8cf-4478-af61-b55ad1620747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.018318 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a28a3d-d8cf-4478-af61-b55ad1620747 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.018602 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a28a3d-d8cf-4478-af61-b55ad1620747 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.018876 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a28a3d-d8cf-4478-af61-b55ad1620747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.027496 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a28a3d-d8cf-4478-af61-b55ad1620747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.028956 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a28a3d-d8cf-4478-af61-b55ad1620747 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.037987 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1426/2836] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:19:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:19:12.305709 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.307110 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:12.318527 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b394ca-4909-4d1b-bc0a-466f65f455a4 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.323678 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.324541 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.324824 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.325097 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] PATH_INFO: `/v3/projects/6c2bff858ea84c0bbd64923029cdb27d` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.326319 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2bff858ea84c0bbd64923029cdb27d)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.328252 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.373583 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2bff858ea84c0bbd64923029cdb27d', 'request_id': 'req-67ba3980-238b-4b9c-a673-1ebab103fe96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:12.379457 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2bff858ea84c0bbd64923029cdb27d', 'request_id': 'req-67ba3980-238b-4b9c-a673-1ebab103fe96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:12.386493 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2bff858ea84c0bbd64923029cdb27d', 'request_id': 'req-67ba3980-238b-4b9c-a673-1ebab103fe96'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:12.397883 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] The token cache is being invalidate because project 6c2bff858ea84c0bbd64923029cdb27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:19:12.398180 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:12.398794 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-67ba3980-238b-4b9c-a673-1ebab103fe96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:12.400342 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1411/2837] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:19:12 2021] DELETE /identity/v3/projects/6c2bff858ea84c0bbd64923029cdb27d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:19:12.406418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.406714 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.407035 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.423739 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:19:12.424888 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:12.480312 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1427/2838] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:19:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:19:12.487638 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.488036 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.488314 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.505891 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:19:12.507066 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:12.514161 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1412/2839] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:19:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:19:12.518096 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.527422 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525862a-89ae-4e7d-9754-e5f83679371b None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.531708 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.532352 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.532641 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.532918 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] PATH_INFO: `/v3/domains` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.533634 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=72636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:19:12.533942 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.535646 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.546680 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1428/2840] 10.222.0.66 () {58 vars in 1153 bytes} [Tue Jul 13 09:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:19:12.551136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.559417 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b750e-44f3-4a3a-8177-d64585d3463b None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.563719 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.564357 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.564634 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.564924 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.565580 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.568237 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.592423 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1413/2841] 10.222.0.66 () {60 vars in 1153 bytes} [Tue Jul 13 09:19:12 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:19:12.596418 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.606280 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47c466-156a-4af3-bb89-d3fe1c947091 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.658693 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.659376 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.660399 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.660690 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] PATH_INFO: `/v3/users` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.661377 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.663329 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.682009 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1429/2842] 10.222.0.66 () {60 vars in 1144 bytes} [Tue Jul 13 09:19:12 2021] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:19:12.686030 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.695446 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f47921-3d71-4802-9472-919406b5eb5a admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.699920 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.700576 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.700859 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.701140 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] PATH_INFO: `/v3/roles` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.701855 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.703498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.714596 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1414/2843] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:19:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:19:12.718359 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.728183 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212834ea-57cf-4e1c-83f3-b8e9f3bc7826 admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.732572 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed584327-b7e8-45c7-a75a-c6f3d2f8fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.733181 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584327-b7e8-45c7-a75a-c6f3d2f8fada admin admin] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.733462 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584327-b7e8-45c7-a75a-c6f3d2f8fada admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.733736 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584327-b7e8-45c7-a75a-c6f3d2f8fada admin admin] PATH_INFO: `/v3/roles` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.734444 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed584327-b7e8-45c7-a75a-c6f3d2f8fada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.736060 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed584327-b7e8-45c7-a75a-c6f3d2f8fada admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.745826 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1430/2844] 10.222.0.66 () {58 vars in 1122 bytes} [Tue Jul 13 09:19:12 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:19:12.749837 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.758879 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3c46e-dc79-4137-8b3c-0b8228cb63ba admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.763177 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.764064 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] REQUEST_METHOD: `PUT` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.764341 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.764612 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] PATH_INFO: `/v3/projects/9408229aeee146b3a03bf64a11df0510/users/4c5b2e0c553044a0a8379e112e658b77/roles/203bf99a9ac2403da939ebc0cc300d68` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.778827 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9408229aeee146b3a03bf64a11df0510, user_id=4c5b2e0c553044a0a8379e112e658b77, role_id=203bf99a9ac2403da939ebc0cc300d68)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.781462 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.794141 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1415/2845] 10.222.0.66 () {60 vars in 1483 bytes} [Tue Jul 13 09:19:12 2021] PUT /identity/v3/projects/9408229aeee146b3a03bf64a11df0510/users/4c5b2e0c553044a0a8379e112e658b77/roles/203bf99a9ac2403da939ebc0cc300d68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:19:12.804847 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] REQUEST_METHOD: `POST` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.805238 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.805600 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.831385 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.auth.core [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] MFA Rules not processed for user `4c5b2e0c553044a0a8379e112e658b77`. Rule list: `[]` (Enabled: `True`). {{(pid=72636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:19:12.833057 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:12.892607 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1431/2846] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:19:12 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:19:12.902741 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:12.904498 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:12.959512 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb65c3-293e-4867-a04d-4336b161e655 admin admin] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:12.963042 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a90d3-295d-498e-9dba-5588ee65404a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '679ea61fafe040cdb5235aae7ff59f81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:12.963676 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a90d3-295d-498e-9dba-5588ee65404a service cinder] REQUEST_METHOD: `GET` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:12.963975 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a90d3-295d-498e-9dba-5588ee65404a service cinder] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:12.964234 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a90d3-295d-498e-9dba-5588ee65404a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:12.972049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a90d3-295d-498e-9dba-5588ee65404a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:12.974059 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a90d3-295d-498e-9dba-5588ee65404a service cinder] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:12.982136 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1416/2847] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:19:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:19:22.507533 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:22.583881 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54bfb5-1897-4e1f-a160-9167c3b817a7 None None] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:22.588161 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:22.589007 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:22.589291 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:22.589564 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] PATH_INFO: `/v3/users/4c5b2e0c553044a0a8379e112e658b77` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:22.590689 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5b2e0c553044a0a8379e112e658b77)` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:22.592652 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:22.635950 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5b2e0c553044a0a8379e112e658b77'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:22.642350 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5b2e0c553044a0a8379e112e658b77'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:22.643041 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5b2e0c553044a0a8379e112e658b77'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:22.654368 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5b2e0c553044a0a8379e112e658b77'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:22.661908 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.notifications [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5b2e0c553044a0a8379e112e658b77'} {{(pid=72636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:22.667805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1432/2848] 10.222.0.66 () {58 vars in 1224 bytes} [Tue Jul 13 09:19:22 2021] DELETE /identity/v3/users/4c5b2e0c553044a0a8379e112e658b77 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:19:22.672344 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] REQUEST_METHOD: `POST` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:22.672812 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:22.672926 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:22.701288 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.auth.core [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] MFA Rules not processed for user `fe1a2ced475c48049c83dfdc6c90aecc`. Rule list: `[]` (Enabled: `True`). {{(pid=72637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:19:22.702450 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:22.758360 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1417/2849] 10.222.0.66 () {58 vars in 958 bytes} [Tue Jul 13 09:19:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:19:22.767861 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:22.769180 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:22.843334 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450bb6-478a-4a9e-b0e1-b44ecf379aab admin admin] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:22.846805 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e987011ba5584a8985871401a7cc5923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:22.847475 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:22.848363 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:22.848632 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:22.857034 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:22.858460 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:22.867069 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1433/2850] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:19:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:19:23.131295 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] Authenticating user token {{(pid=72637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:23.132667 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.fernet_utils [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:23.143452 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a367d1a-e0ff-400f-af2d-23dacc663088 None None] Validating token access rules against request {{(pid=72637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:23.148584 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1a2ced475c48049c83dfdc6c90aecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25cc3ad984ea4044b5e9444df5ff7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:23.149430 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:23.149708 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] SCRIPT_NAME: `/identity` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:23.149984 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] PATH_INFO: `/v3/projects/9408229aeee146b3a03bf64a11df0510` {{(pid=72637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:23.151143 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9408229aeee146b3a03bf64a11df0510)` {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:23.153061 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] RBAC: Authorization granted {{(pid=72637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:23.197947 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9408229aeee146b3a03bf64a11df0510', 'request_id': 'req-f856783e-ef37-4d0d-b1be-ae1ad2531905'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:23.203098 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9408229aeee146b3a03bf64a11df0510', 'request_id': 'req-f856783e-ef37-4d0d-b1be-ae1ad2531905'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:23.211049 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9408229aeee146b3a03bf64a11df0510', 'request_id': 'req-f856783e-ef37-4d0d-b1be-ae1ad2531905'} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:23.222554 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] The token cache is being invalidate because project 9408229aeee146b3a03bf64a11df0510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=72637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:19:23.223829 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:23.224781 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: DEBUG keystone.notifications [None req-f856783e-ef37-4d0d-b1be-ae1ad2531905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=72637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:19:23.226469 dv-cinder-800430-2-iscsi devstack@keystone.service[72637]: [pid: 72637|app: 0|req: 1418/2851] 10.222.0.66 () {58 vars in 1233 bytes} [Tue Jul 13 09:19:23 2021] DELETE /identity/v3/projects/9408229aeee146b3a03bf64a11df0510 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:19:35.902825 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] Authenticating user token {{(pid=72636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:19:35.904172 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:35.968782 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96b7c-57f3-43c3-82b0-c7c826b7a3d7 service neutron] Validating token access rules against request {{(pid=72636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:19:36.024265 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056919d757294178b647759f5c9809c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8f21c7bebb45a986d9b39b4416b709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:19:36.024898 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] REQUEST_METHOD: `GET` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:19:36.025179 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] SCRIPT_NAME: `/identity` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:19:36.025452 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=72636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:19:36.027147 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.fernet_utils [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=72636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:19:36.037549 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:19:36.039153 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc75e-172e-435d-80e8-a028b5e84b1c service placement] RBAC: Authorization granted {{(pid=72636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:19:36.047990 dv-cinder-800430-2-iscsi devstack@keystone.service[72636]: [pid: 72636|app: 0|req: 1434/2852] 10.222.0.66 () {60 vars in 1366 bytes} [Tue Jul 13 09:19:35 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)